-- Logs begin at Tue 2022-06-21 14:17:44 UTC, end at Tue 2022-06-21 15:43:58 UTC. -- Jun 21 14:58:46.071041 dv-cinder-799871-20-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 21 14:58:46.078241 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 21 14:58:46.080238 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 14:58:46 2022] *** Jun 21 14:58:46.080238 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 14:58:46.080238 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 14:58:46.080238 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: nodename: dv-cinder-799871-20-iscsi Jun 21 14:58:46.080238 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: machine: x86_64 Jun 21 14:58:46.080238 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: clock source: unix Jun 21 14:58:46.080238 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: pcre jit disabled Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: detected number of CPU cores: 4 Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: current working directory: / Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: detected binary path: /usr/bin/uwsgi-core Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: your processes number limit is 47680 Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: your memory page size is 4096 bytes Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: detected max file descriptor number: 2048 Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: lock engine: pthread robust mutexes Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: thunder lock: enabled Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 21 14:58:46.080785 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 14:58:46.126445 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: Python main interpreter initialized at 0x55da838219c0 Jun 21 14:58:46.126445 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: python threads support enabled Jun 21 14:58:46.126445 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: your server socket listen backlog is limited to 100 connections Jun 21 14:58:46.126445 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: your mercy for graceful operations on workers is 90 seconds Jun 21 14:58:46.126845 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 14:58:46.126947 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: *** Operational MODE: preforking *** Jun 21 14:58:46.127255 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: *** uWSGI is running in multiple interpreter mode *** Jun 21 14:58:46.127255 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: spawned uWSGI master process (pid: 80305) Jun 21 14:58:46.127455 dv-cinder-799871-20-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 21 14:58:46.128835 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: spawned uWSGI worker 1 (pid: 80315, cores: 1) Jun 21 14:58:46.128835 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: spawned uWSGI worker 2 (pid: 80316, cores: 1) Jun 21 14:58:46.128835 dv-cinder-799871-20-iscsi devstack@keystone.service[80305]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 14:58:51.631130 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 14:58:51.631130 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jun 21 14:58:51.631938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 14:58:51.631938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jun 21 14:58:51.632055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 14:58:51.632055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jun 21 14:58:51.632467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 14:58:51.632467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jun 21 14:58:51.681216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 14:58:51.681396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 14:58:51.681505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 14:58:51.681597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 14:58:51.681678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] command line args: [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 14:58:51.681757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] command line args: [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 14:58:51.681877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 14:58:51.681963 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 14:58:51.682063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ================================================================================ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 14:58:51.682149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ================================================================================ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 14:58:51.682317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.682395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.682563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] config_dir = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.682648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] config_dir = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.682746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.682825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.682928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] config_source = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.683014 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] config_source = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.683094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] debug = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.683165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] debug = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.683289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.683599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.683739 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.683838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.683932 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_config_append = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_config_append = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.684925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_dir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_dir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685769 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.685974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686139 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.686914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.687036 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.687548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.687635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.687753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.687866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.687947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688317 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.688925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.90/identity {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.90/identity {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] publish_errors = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] publish_errors = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689754 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.689973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.690594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] standard_threads = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] standard_threads = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691581 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691831 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_journal = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_journal = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.691959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_json = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.692023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_json = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.692082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_stderr = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.692176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_stderr = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.692522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_syslog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.692657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_syslog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.692782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.692899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 14:58:51.692976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693199 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.693867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.694020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.694105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.694268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.694358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.694506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.694591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.694749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.694827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.694995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.695081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.695225 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.695371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.695449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.695519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.695688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.695780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.695922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.696006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.696162 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.696242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.696395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.696553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.696629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.696706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.696870 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.696970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.697113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.697203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.697353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.697431 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.697609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.697687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.697863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.697954 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.698111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.698189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.698357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.698442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.698586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.698673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.698814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.698899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.699042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.699125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.699272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.699351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.699507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.699591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.699751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.699836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.699978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.700058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.700207 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.700288 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.700433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.700510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.700676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.700755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.700908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.700986 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.701141 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.701219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.701366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.701445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.701621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.701703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.701856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.701969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.702117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.702183 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.702317 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.702398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.702517 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.702603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.702740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.702826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.702968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.703047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.703203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.703282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.703426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.703507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.703795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.703890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.703960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.704020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.704090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.704152 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.704322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.704403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.704605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.704697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.704784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.704860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.705005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.705101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.705237 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.705509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.705509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.706374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.706532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.706652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.706751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.706849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.706977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707206 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707323 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.707977 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.708145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.708228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.708376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.708459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.708604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.708685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.708836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.708914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.709068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.709149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.709320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.709399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.709581 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.709676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.709822 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.709901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.710054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.710134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.710287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.710376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.710518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.710603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.710750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.710834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.710981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.711067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.711214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.711299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.711447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.711532 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.711677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.711763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.711911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.711991 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.712142 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.712221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.712374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.712460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.712604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.712683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.712837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.712915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.713086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.713172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.713324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.713402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.713580 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.713671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.713818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.713971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.714048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.714119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.714268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.714349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.714499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.714592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.714727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.714818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.714953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.715046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.715179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.715258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.715408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.715495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.715631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.715710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.715857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.715935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.716086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.716173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.716317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.716401 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.716551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.716629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.716783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.716869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.717037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.717116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.717275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.717353 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.717522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.external = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.717607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.717754 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.717833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.external = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.717981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.718059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.718260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.718351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.718488 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.password = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.718569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.718714 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.password = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.718793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.token = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.718943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.token = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.719024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.719175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.719266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.719406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.719491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.719631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.719711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.719870 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.719950 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.720109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.720188 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.720335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.720415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.720567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.720649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.720798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.720877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.721042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.721122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.721328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.721461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.721642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.721769 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.721912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722166 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722316 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.722999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.723086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.723251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.723338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.723518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.723598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.723764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.723843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.724011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.724103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.724266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.724348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.724501 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.724582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.724738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.724818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.724974 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.725055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.725218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.725303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.725447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.725590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.725705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.725787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.725937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.726017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.726177 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.726256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.726412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.726492 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.726653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.726732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.726886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.726965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.727131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.727211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.727362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.727442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.727600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.727679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.727843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.727921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.728065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.728146 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.728298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.728386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.728530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.728611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.728755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.728834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.728990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.729077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.729225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.729304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.729519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.729603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.729718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.729811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.729946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.730034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.730175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.730255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.730404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.730493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.730644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.730723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.730886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.730966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.731130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.731218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.731370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.731450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.731619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.731700 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.731858 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.731945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.732103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.732185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.732324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.732405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.732553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.732640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.732777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.732856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.733005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.733084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.733238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.733325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.733491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.733573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.733736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.733816 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.733960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.734051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.734199 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.734279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.734441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.734520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.734673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.734761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.734909 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.734988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.735147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.735225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.735372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.735461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.735606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.735685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.735829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.735908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.736056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.736143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.736294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.736406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.736523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.736606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.736755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.737372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.737564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738348 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.738925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.739008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.739175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.739263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.739408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.739499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.739641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.739723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.739868 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.739950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.740096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.740188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.740336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.740417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.740562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.740643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.740805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.740888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.741048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.741129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.741291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.741371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.741542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.741628 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.741771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.741852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.741997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.742076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.742225 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.742307 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.742455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.742535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.742679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.742759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.742905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.742987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.743150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.743231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.743387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.743468 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.743628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.743711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.743870 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.743951 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.744092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.744182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.744328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.744414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.744558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.744639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.744789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.744873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.745021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.745104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.745252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.745341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.745504 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.745587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.745752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.745835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.745985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.746067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.746228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.746324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.746449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.746536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.746674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.746753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.746910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.746991 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.747142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.747224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.747373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.747453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.747607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.747686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.747844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.747926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.748072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.748153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.748300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.748380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.748532 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.748613 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.748767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.748847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.749008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.749095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.749238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.749320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.749488 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.749572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.749737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.749820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.749972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.750054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.750206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.750285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.750443 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.750523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.750678 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.750756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.750897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] role.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.750979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.751130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] role.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.751210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] role.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.751353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.751436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] role.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.751593 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.751681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.751885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.751985 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.752071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.752152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.752307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.752389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.752624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.753720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.753720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.753866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.753928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754300 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754595 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.754903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.755063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.755147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.755342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.755436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.755669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.755749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.755916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.755997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.756160 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.756250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.756403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.756486 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.756649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.756729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.756878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.756968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.757114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.757195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.757362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.757442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.757622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.757769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.757853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.758013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.758094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.758245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.758326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.758478 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.758567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.758709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.758791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.758959 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.759048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.759203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.759284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.759435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.759516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.759660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.759750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.759891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.759972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.760115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.760204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.760350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.760440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.760581 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.760662 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.760824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.760905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.761060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.761150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.761288 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.761369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.761553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.761664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.761794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.761901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.762033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.762115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.762261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.762342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.762495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.762585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.762725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.762806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.762959 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.763039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.763192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.763284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.763415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.763496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.763667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.763748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.763892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.763980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.764133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.764213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.764429 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.764520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.764674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.764756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.764916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.765007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.765153 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.765237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.765385 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.765480 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.765640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.765722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.765875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.765964 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.766105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.766185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.766336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.766416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.766566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.766648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.766806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.766886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.767035 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.767116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.767275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.767357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.767504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.767584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.767746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.767826 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.767970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.768052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.768392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.768828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.768828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.768969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.768969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 14:58:51.769118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.769118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 14:58:51.769253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 14:58:51.800771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.800993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.801215 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.801463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.801726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.801952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.809748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.810461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.837895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.838122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.838788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.839023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.980835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:51.981791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.030078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.030212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.030320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.030434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.094638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.094867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.095066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.095158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.095293 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.095381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.095508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.095625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.095711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.095800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.095922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.096140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.120903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.121159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.121296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.121387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.121497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.121582 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.121661 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.121778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.121867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.121989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.122075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.122200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.122286 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.122480 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.133775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.134287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.147058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.147285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.147488 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.147576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.147707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.147791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.147921 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.148021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.148133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.148219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.148344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.148430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.148557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.148771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 14:58:52.165596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.165802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 14:58:52.165895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.166010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 14:58:52.166136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.166333 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 14:58:52.166419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.166529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 14:58:52.166612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.166795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.166889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.167054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.167137 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.167308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.167391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.167565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.178269 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.178541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.178805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.178892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.179080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.179182 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.179348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.179625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.187327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.187900 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.191294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.191564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.191840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.191925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.192111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.192213 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.192384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.192470 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.192638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.192724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.192900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.192987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.193166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.193251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.193428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.193538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.193722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.193809 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.193985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.194068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.194278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.194543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.220460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.220859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.222779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.223037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.223140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.223313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.228293 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.228598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.228684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.228957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.229054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.229254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.236263 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.236539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.236624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.237599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.241737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.242024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.242131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.242306 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.242418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.242585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.242672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.242851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.242936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.243130 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.243224 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.243392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.243474 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.243653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.243736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.243922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.262185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.262448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.262706 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.262980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.266971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.267622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.270627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.271016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.271284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.271679 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.275977 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.276677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.279536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.280280 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.283156 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.283452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.284263 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.284465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.284574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.284748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.284843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.285033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.285128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.285310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.285611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.285887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.304186 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.304462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.304733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.304998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.305142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.305421 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.305711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.305983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.312769 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.313825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.314481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.314750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.316116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.316400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.318441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.318717 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.318990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.319290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.319624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.319708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.319904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.320185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.320490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.320824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.332838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.333110 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.333392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.333692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.334274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.334550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.334840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.335119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.335229 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.335519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.335804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.336685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.336976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.337275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.353888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.355697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.357115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.358992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.360401 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.362758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.362969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.364372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.364643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.364815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.364900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.366483 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.366761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.367045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.372134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.373729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.374304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.375905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.376916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.377199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.377643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.377918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.379167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.379451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.379836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.380112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.386852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.387136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.387418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.389157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.389443 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.389744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.395289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.395559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.395835 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.396105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.396370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.396744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.397030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.397294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.397583 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.397707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 14:58:52.397852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.397983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.398119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.398260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.398374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.398531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.398649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.398805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.398890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.399188 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.399463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.399739 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.400008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.400283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.400551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.400818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.401080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.401358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 14:58:52.437704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55da838219c0 pid: 80315 (default app) Jun 21 14:58:52.440754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55da838219c0 pid: 80316 (default app) Jun 21 14:58:52.441025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8fdd8-b66d-4765-9e7a-d59252ddd69f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:58:52.441328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8fdd8-b66d-4765-9e7a-d59252ddd69f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:58:52.441634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8fdd8-b66d-4765-9e7a-d59252ddd69f None None] PATH_INFO: `/v3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:58:52.445746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 791 bytes} [Tue Jun 21 14:58:52 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:00.471156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20089d21-cc2d-4b19-b5f5-2edaa8bb651e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:00.471736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20089d21-cc2d-4b19-b5f5-2edaa8bb651e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:00.471736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20089d21-cc2d-4b19-b5f5-2edaa8bb651e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:00.476001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1/2] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:00.482023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:00.482411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:00.482575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:00.551439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: INFO dbcounter [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] Registered counter for database keystone Jun 21 14:59:00.572153 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG oslo_db.sqlalchemy.engines [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 14:59:00.578286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writer thread running {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 14:59:00.760620 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80315) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 14:59:00.760951 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80315) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 14:59:00.816584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:00.818218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:00.940509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 2/3] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 14:59:01.079597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20089d21-cc2d-4b19-b5f5-2edaa8bb651e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:01.149943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: INFO dbcounter [None req-20089d21-cc2d-4b19-b5f5-2edaa8bb651e None None] Registered counter for database keystone Jun 21 14:59:01.168984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG oslo_db.sqlalchemy.engines [None req-20089d21-cc2d-4b19-b5f5-2edaa8bb651e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 14:59:01.178009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writer thread running {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 14:59:01.298256 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20089d21-cc2d-4b19-b5f5-2edaa8bb651e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:01.304987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e12bc-90aa-4480-82fd-2b25fc64ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:01.305690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e12bc-90aa-4480-82fd-2b25fc64ca71 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:01.305969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e12bc-90aa-4480-82fd-2b25fc64ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:01.306250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e12bc-90aa-4480-82fd-2b25fc64ca71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:01.315805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e12bc-90aa-4480-82fd-2b25fc64ca71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:01.366911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WARNING keystone.common.rbac_enforcer.enforcer [None req-570e12bc-90aa-4480-82fd-2b25fc64ca71 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 14:59:01.367186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e12bc-90aa-4480-82fd-2b25fc64ca71 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:01.377668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 2/4] 10.222.0.90 () {58 vars in 1324 bytes} [Tue Jun 21 14:59:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 14:59:01.383703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:01.398287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc26332-39a6-42c9-8013-9d9e06cc0ed6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:01.402749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fb399-c8bc-4b19-b650-74cc1c4ea8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:01.403853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fb399-c8bc-4b19-b650-74cc1c4ea8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:01.404157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fb399-c8bc-4b19-b650-74cc1c4ea8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:01.404439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fb399-c8bc-4b19-b650-74cc1c4ea8ec admin admin] PATH_INFO: `/v3/projects/48272287173249c5b6cf381e320026f5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:01.408615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fb399-c8bc-4b19-b650-74cc1c4ea8ec admin admin] RBAC: Authorizing `identity:get_project(project_id=48272287173249c5b6cf381e320026f5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:01.459735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ae3fb399-c8bc-4b19-b650-74cc1c4ea8ec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 14:59:01.460080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fb399-c8bc-4b19-b650-74cc1c4ea8ec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:01.464678 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 3/5] 10.222.0.90 () {56 vars in 1207 bytes} [Tue Jun 21 14:59:01 2022] GET /identity/v3/projects/48272287173249c5b6cf381e320026f5 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:03.536391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340c72-3704-4f73-9e34-92f2618694d6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:03.536931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340c72-3704-4f73-9e34-92f2618694d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:03.536931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340c72-3704-4f73-9e34-92f2618694d6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:03.541012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 3/6] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:03.546293 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380d696-f291-462c-b451-a30364a1a33e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:03.546701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380d696-f291-462c-b451-a30364a1a33e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:03.547127 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380d696-f291-462c-b451-a30364a1a33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:03.566962 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6380d696-f291-462c-b451-a30364a1a33e None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:03.568485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6380d696-f291-462c-b451-a30364a1a33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:03.576403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 4/7] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 14:59:03.599517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340c72-3704-4f73-9e34-92f2618694d6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:03.612603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340c72-3704-4f73-9e34-92f2618694d6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:03.616819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287219c8-563e-4df5-87db-24e16a549f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:03.617449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287219c8-563e-4df5-87db-24e16a549f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:03.617776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287219c8-563e-4df5-87db-24e16a549f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:03.618060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287219c8-563e-4df5-87db-24e16a549f30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:03.625773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287219c8-563e-4df5-87db-24e16a549f30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:03.628730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287219c8-563e-4df5-87db-24e16a549f30 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:03.637495 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 4/8] 10.222.0.90 () {58 vars in 1324 bytes} [Tue Jun 21 14:59:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 14:59:03.642988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380d696-f291-462c-b451-a30364a1a33e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:03.651967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380d696-f291-462c-b451-a30364a1a33e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:03.656327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d2ab-28f2-4488-9d01-2b89b9f0e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:03.657180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d2ab-28f2-4488-9d01-2b89b9f0e81b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:03.657494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d2ab-28f2-4488-9d01-2b89b9f0e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:03.657773 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d2ab-28f2-4488-9d01-2b89b9f0e81b admin admin] PATH_INFO: `/v3/users/942b864bb91e4374a593803fb944209b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:03.659300 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d2ab-28f2-4488-9d01-2b89b9f0e81b admin admin] RBAC: Authorizing `identity:get_user(user_id=942b864bb91e4374a593803fb944209b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:03.661113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d2ab-28f2-4488-9d01-2b89b9f0e81b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:03.662702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 5/9] 10.222.0.90 () {56 vars in 1198 bytes} [Tue Jun 21 14:59:03 2022] GET /identity/v3/users/942b864bb91e4374a593803fb944209b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:05.763007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68adbfb-2bcd-499d-9165-9a68d78e3395 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:05.763546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68adbfb-2bcd-499d-9165-9a68d78e3395 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:05.763546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68adbfb-2bcd-499d-9165-9a68d78e3395 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:05.764897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 5/10] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:05.770602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b513fc-3797-44b1-876a-5b410948a879 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:05.771024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b513fc-3797-44b1-876a-5b410948a879 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:05.771175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b513fc-3797-44b1-876a-5b410948a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:05.788838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c5b513fc-3797-44b1-876a-5b410948a879 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:05.790047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c5b513fc-3797-44b1-876a-5b410948a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:05.816083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b7d50-1120-4609-800e-2c03c3f29853 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:05.816372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b7d50-1120-4609-800e-2c03c3f29853 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:05.816657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b7d50-1120-4609-800e-2c03c3f29853 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:05.818041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 6/11] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:05.823075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673d89-2a6b-4a1c-8f70-945c5a4a10dd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:05.823369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673d89-2a6b-4a1c-8f70-945c5a4a10dd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:05.823655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab673d89-2a6b-4a1c-8f70-945c5a4a10dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:05.864344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-ab673d89-2a6b-4a1c-8f70-945c5a4a10dd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80316) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 14:59:05.864767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-ab673d89-2a6b-4a1c-8f70-945c5a4a10dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80316) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 14:59:05.871698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 6/12] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:05.895433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b513fc-3797-44b1-876a-5b410948a879 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:05.910694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ab673d89-2a6b-4a1c-8f70-945c5a4a10dd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:05.912251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ab673d89-2a6b-4a1c-8f70-945c5a4a10dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:05.919076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:06.003511 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b513fc-3797-44b1-876a-5b410948a879 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:06.012690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 7/13] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:06.035875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673d89-2a6b-4a1c-8f70-945c5a4a10dd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:06.036860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695dea9-567b-4faa-83f4-ea055859d111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:06.037702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695dea9-567b-4faa-83f4-ea055859d111 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:06.037992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695dea9-567b-4faa-83f4-ea055859d111 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:06.038273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695dea9-567b-4faa-83f4-ea055859d111 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:06.049802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695dea9-567b-4faa-83f4-ea055859d111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f695dea9-567b-4faa-83f4-ea055859d111 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:06.060893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:06.061960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:06.062796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 7/14] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 14:59:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:06.068240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695dea9-567b-4faa-83f4-ea055859d111 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:06.138876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab673d89-2a6b-4a1c-8f70-945c5a4a10dd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:06.141275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:06.148030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:06.167024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695dea9-567b-4faa-83f4-ea055859d111 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:06.176329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdc297-00fb-4d1d-9872-82abb0cdbedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:06.177240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdc297-00fb-4d1d-9872-82abb0cdbedc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:06.177564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdc297-00fb-4d1d-9872-82abb0cdbedc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:06.177850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdc297-00fb-4d1d-9872-82abb0cdbedc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:06.202673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212de9b-237c-49f0-9e5c-cc15ed6a9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:06.203336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212de9b-237c-49f0-9e5c-cc15ed6a9a4b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:06.203628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212de9b-237c-49f0-9e5c-cc15ed6a9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:06.203911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212de9b-237c-49f0-9e5c-cc15ed6a9a4b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:06.205656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212de9b-237c-49f0-9e5c-cc15ed6a9a4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:06.206069 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212de9b-237c-49f0-9e5c-cc15ed6a9a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:06.207525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212de9b-237c-49f0-9e5c-cc15ed6a9a4b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:06.219268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 8/15] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:06.225213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212de9b-237c-49f0-9e5c-cc15ed6a9a4b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:06.245580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdc297-00fb-4d1d-9872-82abb0cdbedc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:06.247111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdc297-00fb-4d1d-9872-82abb0cdbedc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:06.329231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212de9b-237c-49f0-9e5c-cc15ed6a9a4b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:06.354755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 8/16] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 14:59:06.360683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdc297-00fb-4d1d-9872-82abb0cdbedc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:06.364630 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:06.369990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2496a-e6cd-46d9-9ba3-90fe64b3af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:06.370881 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2496a-e6cd-46d9-9ba3-90fe64b3af9e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:06.371237 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2496a-e6cd-46d9-9ba3-90fe64b3af9e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:06.371526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2496a-e6cd-46d9-9ba3-90fe64b3af9e None admin] PATH_INFO: `/v3/users/942b864bb91e4374a593803fb944209b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:06.372803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2496a-e6cd-46d9-9ba3-90fe64b3af9e None admin] RBAC: Authorizing `identity:get_user(user_id=942b864bb91e4374a593803fb944209b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:06.374292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2496a-e6cd-46d9-9ba3-90fe64b3af9e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:06.375940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 9/17] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:06 2022] GET /identity/v3/users/942b864bb91e4374a593803fb944209b => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:06.381393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2496a-e6cd-46d9-9ba3-90fe64b3af9e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:06.397028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:06.461931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdc297-00fb-4d1d-9872-82abb0cdbedc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:06.483436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2496a-e6cd-46d9-9ba3-90fe64b3af9e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:06.496119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52758b-6423-4569-b016-0f00284003b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:06.496906 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52758b-6423-4569-b016-0f00284003b2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:06.497184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52758b-6423-4569-b016-0f00284003b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:06.497458 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52758b-6423-4569-b016-0f00284003b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:06.517724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52758b-6423-4569-b016-0f00284003b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:06.518227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec0305-df21-4f2b-a620-e62945c9db54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:06.519033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec0305-df21-4f2b-a620-e62945c9db54 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:06.519194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52758b-6423-4569-b016-0f00284003b2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:06.519319 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec0305-df21-4f2b-a620-e62945c9db54 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:06.519606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec0305-df21-4f2b-a620-e62945c9db54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:06.520894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec0305-df21-4f2b-a620-e62945c9db54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:06.522250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec0305-df21-4f2b-a620-e62945c9db54 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:06.523845 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 10/18] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:06.529398 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec0305-df21-4f2b-a620-e62945c9db54 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6f52758b-6423-4569-b016-0f00284003b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 14:59:06.540371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:06.541219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:06.542251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 14:59:06.542251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 14:59:06.542251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 14:59:06.542251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:06.542251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 9/19] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:06.547337 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52758b-6423-4569-b016-0f00284003b2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:06.601609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:06.612566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:06.632431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec0305-df21-4f2b-a620-e62945c9db54 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:06.648109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52758b-6423-4569-b016-0f00284003b2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:06.665518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92da8df-87f7-442f-a918-1a61a9967083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:06.666180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92da8df-87f7-442f-a918-1a61a9967083 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:06.666469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92da8df-87f7-442f-a918-1a61a9967083 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:06.666761 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92da8df-87f7-442f-a918-1a61a9967083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:06.667594 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92da8df-87f7-442f-a918-1a61a9967083 None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.domain.id=default, user.id=942b864bb91e4374a593803fb944209b) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:06.667910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92da8df-87f7-442f-a918-1a61a9967083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:06.669343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92da8df-87f7-442f-a918-1a61a9967083 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:06.677542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 11/20] 10.222.0.90 () {56 vars in 1322 bytes} [Tue Jun 21 14:59:06 2022] GET /identity/v3/role_assignments?user.id=942b864bb91e4374a593803fb944209b&scope.domain.id=default&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:06.681285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2500ff0-27f3-4712-8fc4-445d7c44c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:06.681984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500ff0-27f3-4712-8fc4-445d7c44c940 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:06.682270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500ff0-27f3-4712-8fc4-445d7c44c940 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:06.682552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500ff0-27f3-4712-8fc4-445d7c44c940 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:06.683291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2500ff0-27f3-4712-8fc4-445d7c44c940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:06.683601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2500ff0-27f3-4712-8fc4-445d7c44c940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:06.685042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2500ff0-27f3-4712-8fc4-445d7c44c940 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:06.705380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 10/21] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 14:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:09.027065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaf951-1703-46e6-b6ef-788db7c6c6f8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.028042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaf951-1703-46e6-b6ef-788db7c6c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.028535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaf951-1703-46e6-b6ef-788db7c6c6f8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.030117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 12/22] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:09.036815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ee56-6937-4ec0-a931-bb77d0cfd619 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.037741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ee56-6937-4ec0-a931-bb77d0cfd619 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.038245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ee56-6937-4ec0-a931-bb77d0cfd619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.062503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-87a0ee56-6937-4ec0-a931-bb77d0cfd619 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:09.064371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-87a0ee56-6937-4ec0-a931-bb77d0cfd619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:09.108083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d94a5-7c83-45a8-91f9-dddecd624b52 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.108572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d94a5-7c83-45a8-91f9-dddecd624b52 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.108849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d94a5-7c83-45a8-91f9-dddecd624b52 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.111276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 13/23] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:09.117956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943b9d1-1ad8-4d82-b4a5-ffbf7cafa6f3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.118245 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943b9d1-1ad8-4d82-b4a5-ffbf7cafa6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.118527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943b9d1-1ad8-4d82-b4a5-ffbf7cafa6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.151116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9943b9d1-1ad8-4d82-b4a5-ffbf7cafa6f3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:09.152563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9943b9d1-1ad8-4d82-b4a5-ffbf7cafa6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:09.218189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 11/24] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:09.264072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ee56-6937-4ec0-a931-bb77d0cfd619 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:09.332066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 14/25] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:09.370587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:09.383370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943b9d1-1ad8-4d82-b4a5-ffbf7cafa6f3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:09.515743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ee56-6937-4ec0-a931-bb77d0cfd619 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:09.534762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:09.562626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943b9d1-1ad8-4d82-b4a5-ffbf7cafa6f3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:09.588524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4361b18-696c-4a3f-aef1-c57a68a050f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:09.589556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4361b18-696c-4a3f-aef1-c57a68a050f6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.589682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4361b18-696c-4a3f-aef1-c57a68a050f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.590662 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4361b18-696c-4a3f-aef1-c57a68a050f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.619229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4361b18-696c-4a3f-aef1-c57a68a050f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f4361b18-696c-4a3f-aef1-c57a68a050f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:09.632186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:09.633182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:09.634013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 12/26] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 14:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:09.635288 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1056afb-352b-401a-bade-0ac2f4b88539 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.635288 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1056afb-352b-401a-bade-0ac2f4b88539 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.636026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1056afb-352b-401a-bade-0ac2f4b88539 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.638322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 13/27] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:09.647534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a7b42-664d-493f-9082-1363f9cc3a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:09.648357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a7b42-664d-493f-9082-1363f9cc3a04 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.648642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a7b42-664d-493f-9082-1363f9cc3a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.648925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a7b42-664d-493f-9082-1363f9cc3a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.652454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e068eb8-f003-48bb-b101-9af80c3c475f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.652738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e068eb8-f003-48bb-b101-9af80c3c475f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.653015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e068eb8-f003-48bb-b101-9af80c3c475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.670829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a7b42-664d-493f-9082-1363f9cc3a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:09.672604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a7b42-664d-493f-9082-1363f9cc3a04 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:09.693840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7e068eb8-f003-48bb-b101-9af80c3c475f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:09.695450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7e068eb8-f003-48bb-b101-9af80c3c475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-947a7b42-664d-493f-9082-1363f9cc3a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 14:59:09.715418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:09.716310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:09.717147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 14:59:09.717147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 14:59:09.717147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 14:59:09.717147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:09.717147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 15/28] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:09.717147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a7b42-664d-493f-9082-1363f9cc3a04 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:09.829004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 14/29] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:09.830404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e068eb8-f003-48bb-b101-9af80c3c475f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:09.864533 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a7b42-664d-493f-9082-1363f9cc3a04 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:09.881690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:09.897384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:09.913425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf098ed7-34ca-4ef1-86c3-49bf7379ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:09.914803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf098ed7-34ca-4ef1-86c3-49bf7379ae08 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.914914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf098ed7-34ca-4ef1-86c3-49bf7379ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.915430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf098ed7-34ca-4ef1-86c3-49bf7379ae08 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.919504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf098ed7-34ca-4ef1-86c3-49bf7379ae08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:09.919504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf098ed7-34ca-4ef1-86c3-49bf7379ae08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:09.919504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf098ed7-34ca-4ef1-86c3-49bf7379ae08 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:09.945409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 16/30] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:09.945409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cdddd-4d80-447f-8f49-fa6c5b289cdf None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:09.945409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cdddd-4d80-447f-8f49-fa6c5b289cdf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:09.945409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cdddd-4d80-447f-8f49-fa6c5b289cdf None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:09.945409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 17/31] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:09.947540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cdddd-4d80-447f-8f49-fa6c5b289cdf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:09.999875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e068eb8-f003-48bb-b101-9af80c3c475f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:10.046319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3727f-131c-47f1-a2b0-aaee78d6b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:10.049182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3727f-131c-47f1-a2b0-aaee78d6b980 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.049866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3727f-131c-47f1-a2b0-aaee78d6b980 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.050357 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3727f-131c-47f1-a2b0-aaee78d6b980 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.051433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3727f-131c-47f1-a2b0-aaee78d6b980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:10.052147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3727f-131c-47f1-a2b0-aaee78d6b980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:10.054526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3727f-131c-47f1-a2b0-aaee78d6b980 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:10.073004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 15/32] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 14:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:10.074367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3727f-131c-47f1-a2b0-aaee78d6b980 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:10.105093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cdddd-4d80-447f-8f49-fa6c5b289cdf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:10.147436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc509616-78e6-41fd-8f0f-98f8b3088da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:10.148161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509616-78e6-41fd-8f0f-98f8b3088da6 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.148446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509616-78e6-41fd-8f0f-98f8b3088da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.148723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc509616-78e6-41fd-8f0f-98f8b3088da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.149626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc509616-78e6-41fd-8f0f-98f8b3088da6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:10.151247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc509616-78e6-41fd-8f0f-98f8b3088da6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:10.199691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:10.209291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3727f-131c-47f1-a2b0-aaee78d6b980 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:10.252405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfb870-7881-4ce2-8153-92ad44670182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:10.253721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb870-7881-4ce2-8153-92ad44670182 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.254205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb870-7881-4ce2-8153-92ad44670182 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.254676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb870-7881-4ce2-8153-92ad44670182 None admin] PATH_INFO: `/v3/users/942b864bb91e4374a593803fb944209b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.256652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfb870-7881-4ce2-8153-92ad44670182 None admin] RBAC: Authorizing `identity:get_user(user_id=942b864bb91e4374a593803fb944209b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:10.258525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfb870-7881-4ce2-8153-92ad44670182 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:10.268354 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 16/33] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:10 2022] GET /identity/v3/users/942b864bb91e4374a593803fb944209b => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:10.270101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794da4-ff5a-4ec1-a906-ed00e0864678 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.271028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794da4-ff5a-4ec1-a906-ed00e0864678 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.271501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794da4-ff5a-4ec1-a906-ed00e0864678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.292572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-40794da4-ff5a-4ec1-a906-ed00e0864678 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:10.294243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-40794da4-ff5a-4ec1-a906-ed00e0864678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:10.346767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 18/34] 10.222.0.90 () {60 vars in 1131 bytes} [Tue Jun 21 14:59:09 2022] POST /identity/v3/roles => generated 219 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:10.347840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc509616-78e6-41fd-8f0f-98f8b3088da6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:10.392608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 17/35] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:10.394502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794da4-ff5a-4ec1-a906-ed00e0864678 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:10.415707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:10.516909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc509616-78e6-41fd-8f0f-98f8b3088da6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:10.547062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:10.554964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794da4-ff5a-4ec1-a906-ed00e0864678 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:10.563107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a251d68-3fa7-4e17-bf4d-cce8db6d31f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:10.564552 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a251d68-3fa7-4e17-bf4d-cce8db6d31f9 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.565745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a251d68-3fa7-4e17-bf4d-cce8db6d31f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.566054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a251d68-3fa7-4e17-bf4d-cce8db6d31f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.566803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a251d68-3fa7-4e17-bf4d-cce8db6d31f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:10.568466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a251d68-3fa7-4e17-bf4d-cce8db6d31f9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:10.603597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 19/36] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 14:59:10 2022] POST /identity/v3/projects => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:10.604781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a251d68-3fa7-4e17-bf4d-cce8db6d31f9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:10.623404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b40b47-1aa6-4f86-b4e0-530f12ca81d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:10.626633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b40b47-1aa6-4f86-b4e0-530f12ca81d0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.627362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b40b47-1aa6-4f86-b4e0-530f12ca81d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.627899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b40b47-1aa6-4f86-b4e0-530f12ca81d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.630655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b40b47-1aa6-4f86-b4e0-530f12ca81d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:10.635696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b40b47-1aa6-4f86-b4e0-530f12ca81d0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:10.639647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 18/37] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:10.643232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3958e-ff86-4bba-ab28-9d8bcd781418 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.646512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3958e-ff86-4bba-ab28-9d8bcd781418 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.647111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3958e-ff86-4bba-ab28-9d8bcd781418 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.651735 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 19/38] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:10.653599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3958e-ff86-4bba-ab28-9d8bcd781418 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:10.767972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:10.772766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a251d68-3fa7-4e17-bf4d-cce8db6d31f9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:10.813300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3958e-ff86-4bba-ab28-9d8bcd781418 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:10.838359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7cdb3-e819-46e5-a629-b7edc91484a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:10.839556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7cdb3-e819-46e5-a629-b7edc91484a1 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.840084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7cdb3-e819-46e5-a629-b7edc91484a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.840599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7cdb3-e819-46e5-a629-b7edc91484a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.842815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7cdb3-e819-46e5-a629-b7edc91484a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:10.846070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7cdb3-e819-46e5-a629-b7edc91484a1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:10.862584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41f954-0664-48e3-a470-9683863d804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:10.863766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41f954-0664-48e3-a470-9683863d804b None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.864232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41f954-0664-48e3-a470-9683863d804b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.864713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41f954-0664-48e3-a470-9683863d804b None admin] PATH_INFO: `/v3/domains/default/users/942b864bb91e4374a593803fb944209b/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.866867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 20/39] 10.222.0.90 () {60 vars in 1131 bytes} [Tue Jun 21 14:59:10 2022] POST /identity/v3/roles => generated 225 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:10.867385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41f954-0664-48e3-a470-9683863d804b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=942b864bb91e4374a593803fb944209b, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:10.868414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f82f3-0e23-4f9e-bade-5c22cc1608b3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:10.868783 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f82f3-0e23-4f9e-bade-5c22cc1608b3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:10.869141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f82f3-0e23-4f9e-bade-5c22cc1608b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:10.869833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41f954-0664-48e3-a470-9683863d804b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:10.894444 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6d3f82f3-0e23-4f9e-bade-5c22cc1608b3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:10.896364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6d3f82f3-0e23-4f9e-bade-5c22cc1608b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:10.978456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 21/40] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:11.003378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f82f3-0e23-4f9e-bade-5c22cc1608b3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:11.037104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 20/41] 10.222.0.90 () {58 vars in 1361 bytes} [Tue Jun 21 14:59:10 2022] PUT /identity/v3/domains/default/users/942b864bb91e4374a593803fb944209b/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:11.073600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd970d3-1e38-453f-af79-ec83088fbc04 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:11.074619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd970d3-1e38-453f-af79-ec83088fbc04 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:11.075115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd970d3-1e38-453f-af79-ec83088fbc04 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:11.080537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 21/42] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:11.090013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88b8e-a01f-4cd7-a0f7-8adb9b52157f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:11.090620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88b8e-a01f-4cd7-a0f7-8adb9b52157f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:11.091716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88b8e-a01f-4cd7-a0f7-8adb9b52157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:11.117202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-79d88b8e-a01f-4cd7-a0f7-8adb9b52157f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:11.119846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-79d88b8e-a01f-4cd7-a0f7-8adb9b52157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:11.130430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:11.145624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f82f3-0e23-4f9e-bade-5c22cc1608b3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:11.148778 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:11.230941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 22/43] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:11.255203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d88b8e-a01f-4cd7-a0f7-8adb9b52157f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:11.312019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea61315-0c41-40d7-91b0-a557991910ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:11.312860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea61315-0c41-40d7-91b0-a557991910ee None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:11.313556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea61315-0c41-40d7-91b0-a557991910ee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:11.313932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea61315-0c41-40d7-91b0-a557991910ee None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:11.315150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea61315-0c41-40d7-91b0-a557991910ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:11.317299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea61315-0c41-40d7-91b0-a557991910ee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:11.349510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 22/44] 10.222.0.90 () {60 vars in 1131 bytes} [Tue Jun 21 14:59:11 2022] POST /identity/v3/roles => generated 223 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 14:59:11.364661 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d88b8e-a01f-4cd7-a0f7-8adb9b52157f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:11.408692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfcf7f-276b-4dbf-8df6-1defca013400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:11.409753 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfcf7f-276b-4dbf-8df6-1defca013400 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:11.410051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfcf7f-276b-4dbf-8df6-1defca013400 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:11.410369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfcf7f-276b-4dbf-8df6-1defca013400 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:11.411735 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfcf7f-276b-4dbf-8df6-1defca013400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:11.413648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfcf7f-276b-4dbf-8df6-1defca013400 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:11.415399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 23/45] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:11.421855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea61315-0c41-40d7-91b0-a557991910ee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:11.544926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea61315-0c41-40d7-91b0-a557991910ee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:11.583715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06657014-6067-4cf7-9bf7-2c45db2adb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:11.584380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06657014-6067-4cf7-9bf7-2c45db2adb30 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:11.584669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06657014-6067-4cf7-9bf7-2c45db2adb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:11.585024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06657014-6067-4cf7-9bf7-2c45db2adb30 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:11.585926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06657014-6067-4cf7-9bf7-2c45db2adb30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:11.587467 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06657014-6067-4cf7-9bf7-2c45db2adb30 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:11.614311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 23/46] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 14:59:11 2022] POST /identity/v3/projects => generated 312 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:13.194683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49bb29-fde9-4120-a58b-3df11008daac None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:13.195408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49bb29-fde9-4120-a58b-3df11008daac None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:13.195408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49bb29-fde9-4120-a58b-3df11008daac None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:13.196757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 24/47] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:13.202087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2b3d4-b3fa-4473-8254-6ca3dba6d5e4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:13.202482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2b3d4-b3fa-4473-8254-6ca3dba6d5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:13.202777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2b3d4-b3fa-4473-8254-6ca3dba6d5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:13.208714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:13.222173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-85b2b3d4-b3fa-4473-8254-6ca3dba6d5e4 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:13.223420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-85b2b3d4-b3fa-4473-8254-6ca3dba6d5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:13.291652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 24/48] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:13.316499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49bb29-fde9-4120-a58b-3df11008daac None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:13.338940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:13.419650 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49bb29-fde9-4120-a58b-3df11008daac None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:13.455595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4416792-0bca-4c1f-863d-828a35dde377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:13.456400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416792-0bca-4c1f-863d-828a35dde377 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:13.456695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416792-0bca-4c1f-863d-828a35dde377 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:13.456976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416792-0bca-4c1f-863d-828a35dde377 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:13.467341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4416792-0bca-4c1f-863d-828a35dde377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c4416792-0bca-4c1f-863d-828a35dde377 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:13.475158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:13.476197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:13.477939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 25/49] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 14:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:13.482101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2b3d4-b3fa-4473-8254-6ca3dba6d5e4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:13.612574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2b3d4-b3fa-4473-8254-6ca3dba6d5e4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:13.645944 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:13.651375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e259f3-9f92-4014-b921-5f82f5fb0f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:13.652056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e259f3-9f92-4014-b921-5f82f5fb0f23 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:13.652344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e259f3-9f92-4014-b921-5f82f5fb0f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:13.652627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e259f3-9f92-4014-b921-5f82f5fb0f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:13.653391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e259f3-9f92-4014-b921-5f82f5fb0f23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:13.653724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e259f3-9f92-4014-b921-5f82f5fb0f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:13.655117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e259f3-9f92-4014-b921-5f82f5fb0f23 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:13.663548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 25/50] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:13.669507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4416792-0bca-4c1f-863d-828a35dde377 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:13.736619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661139-4ce0-40ab-a370-e368703a4a64 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:13.736809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661139-4ce0-40ab-a370-e368703a4a64 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:13.737092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661139-4ce0-40ab-a370-e368703a4a64 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:13.738500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 26/51] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:13.743449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9797f-5bec-458b-a434-4bacb53da94f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:13.743744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9797f-5bec-458b-a434-4bacb53da94f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:13.744027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9797f-5bec-458b-a434-4bacb53da94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:13.755691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:13.761250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-95f9797f-5bec-458b-a434-4bacb53da94f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:13.762483 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-95f9797f-5bec-458b-a434-4bacb53da94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:13.779348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4416792-0bca-4c1f-863d-828a35dde377 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:13.814742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4264cdd-a2a7-4132-bd08-9eb5f46f682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:13.815628 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4264cdd-a2a7-4132-bd08-9eb5f46f682f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:13.815924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4264cdd-a2a7-4132-bd08-9eb5f46f682f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:13.816212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4264cdd-a2a7-4132-bd08-9eb5f46f682f None admin] PATH_INFO: `/v3/users/942b864bb91e4374a593803fb944209b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:13.817531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4264cdd-a2a7-4132-bd08-9eb5f46f682f None admin] RBAC: Authorizing `identity:get_user(user_id=942b864bb91e4374a593803fb944209b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:13.818995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4264cdd-a2a7-4132-bd08-9eb5f46f682f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:13.820850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 26/52] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:13 2022] GET /identity/v3/users/942b864bb91e4374a593803fb944209b => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:13.826013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4264cdd-a2a7-4132-bd08-9eb5f46f682f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:13.833894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 27/53] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:13.859230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9797f-5bec-458b-a434-4bacb53da94f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:13.943143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4264cdd-a2a7-4132-bd08-9eb5f46f682f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:13.965150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9797f-5bec-458b-a434-4bacb53da94f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:13.977533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a2a54-3695-4cb0-a399-31c2ffe57a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:13.978336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2a54-3695-4cb0-a399-31c2ffe57a8c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:13.978637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2a54-3695-4cb0-a399-31c2ffe57a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:13.978922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2a54-3695-4cb0-a399-31c2ffe57a8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:13.980118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a2a54-3695-4cb0-a399-31c2ffe57a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:13.981608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a2a54-3695-4cb0-a399-31c2ffe57a8c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:13.983272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 27/54] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:13.989883 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a2a54-3695-4cb0-a399-31c2ffe57a8c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:13.990025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:14.001919 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21458c7-d062-43e7-b5de-8a26cdc5cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:14.002745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21458c7-d062-43e7-b5de-8a26cdc5cabf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:14.003029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21458c7-d062-43e7-b5de-8a26cdc5cabf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:14.003307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21458c7-d062-43e7-b5de-8a26cdc5cabf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:14.004515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21458c7-d062-43e7-b5de-8a26cdc5cabf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:14.006000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21458c7-d062-43e7-b5de-8a26cdc5cabf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:14.007610 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 28/55] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:14.009699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:14.013388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21458c7-d062-43e7-b5de-8a26cdc5cabf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:14.093743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a2a54-3695-4cb0-a399-31c2ffe57a8c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:14.114639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21458c7-d062-43e7-b5de-8a26cdc5cabf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:14.130455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce997250-ce9a-430e-b2a0-623d1efa4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:14.131117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997250-ce9a-430e-b2a0-623d1efa4630 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:14.131413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997250-ce9a-430e-b2a0-623d1efa4630 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:14.131700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997250-ce9a-430e-b2a0-623d1efa4630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:14.132545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce997250-ce9a-430e-b2a0-623d1efa4630 None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.domain.id=default, user.id=942b864bb91e4374a593803fb944209b) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:14.132875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce997250-ce9a-430e-b2a0-623d1efa4630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:14.134376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce997250-ce9a-430e-b2a0-623d1efa4630 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:14.157937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 28/56] 10.222.0.90 () {56 vars in 1322 bytes} [Tue Jun 21 14:59:13 2022] GET /identity/v3/role_assignments?user.id=942b864bb91e4374a593803fb944209b&scope.domain.id=default&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:14.158144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c073b1-64dc-4aff-8bfd-54e976a9c62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:14.158144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c073b1-64dc-4aff-8bfd-54e976a9c62b None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:14.158144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c073b1-64dc-4aff-8bfd-54e976a9c62b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:14.158144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c073b1-64dc-4aff-8bfd-54e976a9c62b None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:14.158519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c073b1-64dc-4aff-8bfd-54e976a9c62b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:14.158519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c073b1-64dc-4aff-8bfd-54e976a9c62b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:14.183189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 29/57] 10.222.0.90 () {60 vars in 1140 bytes} [Tue Jun 21 14:59:14 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 14:59:16.392345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8f1cb-9cbf-49dc-af90-7ace6ff63c1e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:16.392865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8f1cb-9cbf-49dc-af90-7ace6ff63c1e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:16.392980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8f1cb-9cbf-49dc-af90-7ace6ff63c1e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:16.394302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 29/58] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:16.401503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe696b5-c94a-451e-a21a-1abb2110c147 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:16.401907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe696b5-c94a-451e-a21a-1abb2110c147 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:16.402074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe696b5-c94a-451e-a21a-1abb2110c147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:16.418947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dbe696b5-c94a-451e-a21a-1abb2110c147 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:16.420147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dbe696b5-c94a-451e-a21a-1abb2110c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:16.461670 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:16.491219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 30/59] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:16.515707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8f1cb-9cbf-49dc-af90-7ace6ff63c1e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:16.702911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:16.724768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8f1cb-9cbf-49dc-af90-7ace6ff63c1e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:16.757988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8599b4-73fa-4fc3-b1b1-2aeecb5a2318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:16.758763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8599b4-73fa-4fc3-b1b1-2aeecb5a2318 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:16.759052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8599b4-73fa-4fc3-b1b1-2aeecb5a2318 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:16.759333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8599b4-73fa-4fc3-b1b1-2aeecb5a2318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:16.760507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8599b4-73fa-4fc3-b1b1-2aeecb5a2318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:16.761976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8599b4-73fa-4fc3-b1b1-2aeecb5a2318 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:16.763587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 30/60] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:16.769912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe696b5-c94a-451e-a21a-1abb2110c147 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:16.873899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe696b5-c94a-451e-a21a-1abb2110c147 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:16.909292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558156bf-df9e-40fd-b779-33adf24cacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:16.909986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558156bf-df9e-40fd-b779-33adf24cacb9 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:16.910272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558156bf-df9e-40fd-b779-33adf24cacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:16.910546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558156bf-df9e-40fd-b779-33adf24cacb9 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:16.911272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558156bf-df9e-40fd-b779-33adf24cacb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:16.912786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558156bf-df9e-40fd-b779-33adf24cacb9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:16.939907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 31/61] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 14:59:16 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:20.405322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3bde-35d8-4d04-a4f2-415b2896302e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:20.406543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3bde-35d8-4d04-a4f2-415b2896302e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:20.407778 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3bde-35d8-4d04-a4f2-415b2896302e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:20.409770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 31/62] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:20.415637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7400b0a-0d60-4209-b281-de222bec36bd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:20.416544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7400b0a-0d60-4209-b281-de222bec36bd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:20.417033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7400b0a-0d60-4209-b281-de222bec36bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:20.435772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b7400b0a-0d60-4209-b281-de222bec36bd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:20.437008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b7400b0a-0d60-4209-b281-de222bec36bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:20.472696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:20.534183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 32/63] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:20.536314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ccb2b-5fde-4f02-a75d-aab46dbacaeb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:20.536838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ccb2b-5fde-4f02-a75d-aab46dbacaeb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:20.537311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ccb2b-5fde-4f02-a75d-aab46dbacaeb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:20.538890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 32/64] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:20.544464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b5844-65be-42d6-9a1f-11f6111431b4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:20.544764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b5844-65be-42d6-9a1f-11f6111431b4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:20.545051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b5844-65be-42d6-9a1f-11f6111431b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:20.560261 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ccb2b-5fde-4f02-a75d-aab46dbacaeb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:20.575681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-998b5844-65be-42d6-9a1f-11f6111431b4 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:20.576933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-998b5844-65be-42d6-9a1f-11f6111431b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:20.670133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 33/65] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:20.699099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b5844-65be-42d6-9a1f-11f6111431b4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:20.753053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ccb2b-5fde-4f02-a75d-aab46dbacaeb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:20.795331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ace9-7d22-4f61-81f3-8bf59fd38c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:20.796640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ace9-7d22-4f61-81f3-8bf59fd38c59 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:20.797095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ace9-7d22-4f61-81f3-8bf59fd38c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:20.797612 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ace9-7d22-4f61-81f3-8bf59fd38c59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:20.808983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ace9-7d22-4f61-81f3-8bf59fd38c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7182ace9-7d22-4f61-81f3-8bf59fd38c59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:20.817008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:20.818134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:20.819187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:20.821335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 33/66] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:20.822777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98deaa6-00de-4539-8e14-74effc162913 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:20.823225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98deaa6-00de-4539-8e14-74effc162913 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:20.823646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98deaa6-00de-4539-8e14-74effc162913 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:20.825184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 34/67] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:20.830841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02634a80-9b66-4840-aa46-cf77890289d9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:20.831312 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02634a80-9b66-4840-aa46-cf77890289d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:20.832004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02634a80-9b66-4840-aa46-cf77890289d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:20.850168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-02634a80-9b66-4840-aa46-cf77890289d9 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:20.851594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-02634a80-9b66-4840-aa46-cf77890289d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:20.853788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:20.867755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:20.883691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b5844-65be-42d6-9a1f-11f6111431b4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:20.925114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20270a-4f9a-49c6-8072-381a3814e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:20.926200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20270a-4f9a-49c6-8072-381a3814e365 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:20.926577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20270a-4f9a-49c6-8072-381a3814e365 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:20.926867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20270a-4f9a-49c6-8072-381a3814e365 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:20.935588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 35/68] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:20.936856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02634a80-9b66-4840-aa46-cf77890289d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:20.941161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20270a-4f9a-49c6-8072-381a3814e365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8b20270a-4f9a-49c6-8072-381a3814e365 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:20.951388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:20.952360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:20.953184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:20.956832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 34/69] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 14:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:20.967394 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20270a-4f9a-49c6-8072-381a3814e365 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.052257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02634a80-9b66-4840-aa46-cf77890289d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.083459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20270a-4f9a-49c6-8072-381a3814e365 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.092369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de702c-221a-4d71-96dc-dc9af40d5fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.093054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de702c-221a-4d71-96dc-dc9af40d5fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.093759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de702c-221a-4d71-96dc-dc9af40d5fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.094049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de702c-221a-4d71-96dc-dc9af40d5fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.095427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de702c-221a-4d71-96dc-dc9af40d5fd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:21.096079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de702c-221a-4d71-96dc-dc9af40d5fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:21.097500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de702c-221a-4d71-96dc-dc9af40d5fd3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:21.106970 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:21.113620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 36/70] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:21.114912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de702c-221a-4d71-96dc-dc9af40d5fd3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.120780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a248d01-228a-4b07-826b-86c4f02b2573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.121448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a248d01-228a-4b07-826b-86c4f02b2573 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.121763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a248d01-228a-4b07-826b-86c4f02b2573 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.122043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a248d01-228a-4b07-826b-86c4f02b2573 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.122796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a248d01-228a-4b07-826b-86c4f02b2573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:21.123104 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a248d01-228a-4b07-826b-86c4f02b2573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:21.124496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a248d01-228a-4b07-826b-86c4f02b2573 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:21.132899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 35/71] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:21.134279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483eaa4-a019-4357-99a6-c1d72b966261 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.134575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483eaa4-a019-4357-99a6-c1d72b966261 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.134856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483eaa4-a019-4357-99a6-c1d72b966261 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.136084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 36/72] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:21.140033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8598a-6da1-42da-afad-71b16918b52b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.140033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8598a-6da1-42da-afad-71b16918b52b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.140033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8598a-6da1-42da-afad-71b16918b52b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.140033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 37/73] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:21.144247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8598a-6da1-42da-afad-71b16918b52b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.159870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:21.221242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de702c-221a-4d71-96dc-dc9af40d5fd3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.249316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8598a-6da1-42da-afad-71b16918b52b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.256908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a299152-fc02-4978-bb3e-5f4cb974d164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.257747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a299152-fc02-4978-bb3e-5f4cb974d164 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.258036 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a299152-fc02-4978-bb3e-5f4cb974d164 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.258317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a299152-fc02-4978-bb3e-5f4cb974d164 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.269260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a299152-fc02-4978-bb3e-5f4cb974d164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0a299152-fc02-4978-bb3e-5f4cb974d164 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:21.277208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:21.278168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:21.278972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 37/74] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 14:59:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:21.279616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a299152-fc02-4978-bb3e-5f4cb974d164 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.291876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01a5ef-45b6-46b2-8df4-1fd1a5ca2d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.292751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a5ef-45b6-46b2-8df4-1fd1a5ca2d9a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.293034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a5ef-45b6-46b2-8df4-1fd1a5ca2d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.293313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01a5ef-45b6-46b2-8df4-1fd1a5ca2d9a None admin] PATH_INFO: `/v3/users/c5bb8b07d7ca43fca8f1f46e762df820` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.308008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01a5ef-45b6-46b2-8df4-1fd1a5ca2d9a None admin] RBAC: Authorizing `identity:get_user(user_id=c5bb8b07d7ca43fca8f1f46e762df820)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:21.309494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01a5ef-45b6-46b2-8df4-1fd1a5ca2d9a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:21.311221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 38/75] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:21 2022] GET /identity/v3/users/c5bb8b07d7ca43fca8f1f46e762df820 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:21.311221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873be8d8-6862-4d83-b4f1-cf319845b396 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.311221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873be8d8-6862-4d83-b4f1-cf319845b396 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.311221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873be8d8-6862-4d83-b4f1-cf319845b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.331719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-873be8d8-6862-4d83-b4f1-cf319845b396 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:21.332942 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-873be8d8-6862-4d83-b4f1-cf319845b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:21.346262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:21.389412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a299152-fc02-4978-bb3e-5f4cb974d164 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.397913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:21.403338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 39/76] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:21.404602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc7f3-cb20-4531-bccd-22f385f09ad0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.404901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc7f3-cb20-4531-bccd-22f385f09ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.405189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc7f3-cb20-4531-bccd-22f385f09ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.421769 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dd2dc7f3-cb20-4531-bccd-22f385f09ad0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:21.423468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dd2dc7f3-cb20-4531-bccd-22f385f09ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:21.425848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cb80d-e358-4cf1-befe-0d16ef3ef3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.426825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cb80d-e358-4cf1-befe-0d16ef3ef3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.427119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cb80d-e358-4cf1-befe-0d16ef3ef3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.427406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cb80d-e358-4cf1-befe-0d16ef3ef3b4 None admin] PATH_INFO: `/v3/users/942b864bb91e4374a593803fb944209b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.428648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cb80d-e358-4cf1-befe-0d16ef3ef3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=942b864bb91e4374a593803fb944209b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:21.430171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cb80d-e358-4cf1-befe-0d16ef3ef3b4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:21.431806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 38/77] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:21 2022] GET /identity/v3/users/942b864bb91e4374a593803fb944209b => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:21.432569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cb80d-e358-4cf1-befe-0d16ef3ef3b4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.493049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 40/78] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:21.493839 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dc7f3-cb20-4531-bccd-22f385f09ad0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.542580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cb80d-e358-4cf1-befe-0d16ef3ef3b4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.568452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:21.577611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97af2d-58ef-4f44-a1a4-d20103b9b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.578286 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97af2d-58ef-4f44-a1a4-d20103b9b642 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.579103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97af2d-58ef-4f44-a1a4-d20103b9b642 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.579473 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97af2d-58ef-4f44-a1a4-d20103b9b642 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.580230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97af2d-58ef-4f44-a1a4-d20103b9b642 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:21.580615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97af2d-58ef-4f44-a1a4-d20103b9b642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:21.581964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97af2d-58ef-4f44-a1a4-d20103b9b642 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:21.590031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 39/79] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 14:59:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:21.590818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97af2d-58ef-4f44-a1a4-d20103b9b642 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.597831 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dc7f3-cb20-4531-bccd-22f385f09ad0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.626021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:21.632489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403078c0-b41a-423a-baa2-69cb0abe4cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.633416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403078c0-b41a-423a-baa2-69cb0abe4cff None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.633416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403078c0-b41a-423a-baa2-69cb0abe4cff None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.633728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403078c0-b41a-423a-baa2-69cb0abe4cff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.694484 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97af2d-58ef-4f44-a1a4-d20103b9b642 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.703942 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403078c0-b41a-423a-baa2-69cb0abe4cff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:21.705445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403078c0-b41a-423a-baa2-69cb0abe4cff None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:21.729100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230433eb-adf2-4801-844f-f5d335b46bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.729928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230433eb-adf2-4801-844f-f5d335b46bfa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.730216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230433eb-adf2-4801-844f-f5d335b46bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.730504 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230433eb-adf2-4801-844f-f5d335b46bfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.740916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230433eb-adf2-4801-844f-f5d335b46bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-230433eb-adf2-4801-844f-f5d335b46bfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:21.748712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:21.749632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:21.750943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 40/80] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:21.751620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230433eb-adf2-4801-844f-f5d335b46bfa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.803124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:21.814140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 41/81] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:21.814140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403078c0-b41a-423a-baa2-69cb0abe4cff None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.840830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:21.859583 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230433eb-adf2-4801-844f-f5d335b46bfa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.894720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3faf07-73bd-4e99-8c57-e7d80a7223fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.895378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3faf07-73bd-4e99-8c57-e7d80a7223fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.895667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3faf07-73bd-4e99-8c57-e7d80a7223fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.895949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3faf07-73bd-4e99-8c57-e7d80a7223fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.913282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403078c0-b41a-423a-baa2-69cb0abe4cff None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:21.952318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69721b3-016c-46a5-aecc-01fbdb2a61b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:21.953124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69721b3-016c-46a5-aecc-01fbdb2a61b8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:21.953536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69721b3-016c-46a5-aecc-01fbdb2a61b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:21.954454 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69721b3-016c-46a5-aecc-01fbdb2a61b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:21.955702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69721b3-016c-46a5-aecc-01fbdb2a61b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:21.957158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69721b3-016c-46a5-aecc-01fbdb2a61b8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:21.958838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 42/82] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:21.959605 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69721b3-016c-46a5-aecc-01fbdb2a61b8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:21.968717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3faf07-73bd-4e99-8c57-e7d80a7223fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:21.970497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3faf07-73bd-4e99-8c57-e7d80a7223fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:22.019359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:22.056834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:22.061107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69721b3-016c-46a5-aecc-01fbdb2a61b8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:22.073946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 41/83] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:22.074796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3faf07-73bd-4e99-8c57-e7d80a7223fd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:22.098943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a624a-6d70-4300-a99f-50e9479df4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:22.099920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a624a-6d70-4300-a99f-50e9479df4bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:22.100273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a624a-6d70-4300-a99f-50e9479df4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:22.100556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a624a-6d70-4300-a99f-50e9479df4bc None admin] PATH_INFO: `/v3/users/c5bb8b07d7ca43fca8f1f46e762df820` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:22.101822 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a624a-6d70-4300-a99f-50e9479df4bc None admin] RBAC: Authorizing `identity:get_user(user_id=c5bb8b07d7ca43fca8f1f46e762df820)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:22.103264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a624a-6d70-4300-a99f-50e9479df4bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:22.104901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 43/84] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:21 2022] GET /identity/v3/users/c5bb8b07d7ca43fca8f1f46e762df820 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:22.105680 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a624a-6d70-4300-a99f-50e9479df4bc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:22.179012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3faf07-73bd-4e99-8c57-e7d80a7223fd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:22.208712 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a624a-6d70-4300-a99f-50e9479df4bc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:22.215530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94493286-e76e-431b-aecc-57c677d6665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:22.216727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493286-e76e-431b-aecc-57c677d6665e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:22.217021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493286-e76e-431b-aecc-57c677d6665e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:22.217305 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493286-e76e-431b-aecc-57c677d6665e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:22.218104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94493286-e76e-431b-aecc-57c677d6665e None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:22.218807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94493286-e76e-431b-aecc-57c677d6665e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:22.220357 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94493286-e76e-431b-aecc-57c677d6665e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:22.228921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 42/85] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:22.229730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94493286-e76e-431b-aecc-57c677d6665e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:22.246014 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:22.247584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a1e21-1369-4ac2-97eb-e11ed999cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:22.248514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a1e21-1369-4ac2-97eb-e11ed999cf94 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:22.248801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a1e21-1369-4ac2-97eb-e11ed999cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:22.249086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a1e21-1369-4ac2-97eb-e11ed999cf94 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:22.250400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a1e21-1369-4ac2-97eb-e11ed999cf94 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:22.251961 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a1e21-1369-4ac2-97eb-e11ed999cf94 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:22.253709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 44/86] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:22 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:22.254475 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a1e21-1369-4ac2-97eb-e11ed999cf94 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:22.288846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:22.338092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94493286-e76e-431b-aecc-57c677d6665e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:22.358204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a1e21-1369-4ac2-97eb-e11ed999cf94 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:22.372323 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b004de-67d2-43db-bce3-365922590be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:22.373004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b004de-67d2-43db-bce3-365922590be6 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:22.373296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b004de-67d2-43db-bce3-365922590be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:22.373615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b004de-67d2-43db-bce3-365922590be6 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:22.374344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b004de-67d2-43db-bce3-365922590be6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:22.376045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b004de-67d2-43db-bce3-365922590be6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:22.393512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f6852-a6aa-42b2-82d9-a55e60cd72d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:22.394386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f6852-a6aa-42b2-82d9-a55e60cd72d4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:22.394671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f6852-a6aa-42b2-82d9-a55e60cd72d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:22.394949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f6852-a6aa-42b2-82d9-a55e60cd72d4 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:22.396407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f6852-a6aa-42b2-82d9-a55e60cd72d4 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:22.397930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f6852-a6aa-42b2-82d9-a55e60cd72d4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:22.399639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 45/87] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:22 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:22.400486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f6852-a6aa-42b2-82d9-a55e60cd72d4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:22.429503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 43/88] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 14:59:22 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:22.429503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b004de-67d2-43db-bce3-365922590be6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:22.504688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:22.527625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f6852-a6aa-42b2-82d9-a55e60cd72d4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:22.529562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:22.547884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b004de-67d2-43db-bce3-365922590be6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:22.573231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c4099-1b76-41d1-8059-3d0b27575368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:22.573926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4099-1b76-41d1-8059-3d0b27575368 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:22.574226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4099-1b76-41d1-8059-3d0b27575368 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:22.574507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4099-1b76-41d1-8059-3d0b27575368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:22.585308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6c35-6dac-4d8e-98d8-7bca5e4d9027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:22.585539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6c35-6dac-4d8e-98d8-7bca5e4d9027 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:22.585753 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6c35-6dac-4d8e-98d8-7bca5e4d9027 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:22.586024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6c35-6dac-4d8e-98d8-7bca5e4d9027 None admin] PATH_INFO: `/v3/users/c5bb8b07d7ca43fca8f1f46e762df820` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:22.587249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6c35-6dac-4d8e-98d8-7bca5e4d9027 None admin] RBAC: Authorizing `identity:get_user(user_id=c5bb8b07d7ca43fca8f1f46e762df820)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:22.588901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6c35-6dac-4d8e-98d8-7bca5e4d9027 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:22.590400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 44/89] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:22 2022] GET /identity/v3/users/c5bb8b07d7ca43fca8f1f46e762df820 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:22.591826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6c35-6dac-4d8e-98d8-7bca5e4d9027 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:22.665786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4099-1b76-41d1-8059-3d0b27575368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:22.667399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4099-1b76-41d1-8059-3d0b27575368 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:22.719342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6c35-6dac-4d8e-98d8-7bca5e4d9027 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:22.763736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de662c-c80b-44b5-b5db-23b2993ba335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:22.764439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de662c-c80b-44b5-b5db-23b2993ba335 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:22.764741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de662c-c80b-44b5-b5db-23b2993ba335 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:22.765035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de662c-c80b-44b5-b5db-23b2993ba335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:22.767638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de662c-c80b-44b5-b5db-23b2993ba335 None admin] RBAC: Adding query filter params (role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=b2ac89cfedcc4836b5603444826c7753, user.id=c5bb8b07d7ca43fca8f1f46e762df820) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:22.767638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de662c-c80b-44b5-b5db-23b2993ba335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:22.768700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de662c-c80b-44b5-b5db-23b2993ba335 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:22.772349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:22.781692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 45/90] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:22 2022] GET /identity/v3/role_assignments?user.id=c5bb8b07d7ca43fca8f1f46e762df820&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:22.782774 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de662c-c80b-44b5-b5db-23b2993ba335 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:22.820271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 46/91] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:22.825946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c4099-1b76-41d1-8059-3d0b27575368 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:22.838143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:23.001103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de662c-c80b-44b5-b5db-23b2993ba335 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:23.011712 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c4099-1b76-41d1-8059-3d0b27575368 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:23.038747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65738d-11b7-4849-bfee-03c959954357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:23.039420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65738d-11b7-4849-bfee-03c959954357 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:23.039710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65738d-11b7-4849-bfee-03c959954357 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:23.039994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65738d-11b7-4849-bfee-03c959954357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:23.040842 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65738d-11b7-4849-bfee-03c959954357 None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=b2ac89cfedcc4836b5603444826c7753, user.id=942b864bb91e4374a593803fb944209b) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:23.041162 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65738d-11b7-4849-bfee-03c959954357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:23.042796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65738d-11b7-4849-bfee-03c959954357 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:23.049818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 46/92] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:22 2022] GET /identity/v3/role_assignments?user.id=942b864bb91e4374a593803fb944209b&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:23.050644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65738d-11b7-4849-bfee-03c959954357 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:23.097680 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee3cd9-e3ed-4da3-bef6-c14096320ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:23.098270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee3cd9-e3ed-4da3-bef6-c14096320ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:23.098557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee3cd9-e3ed-4da3-bef6-c14096320ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:23.098836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee3cd9-e3ed-4da3-bef6-c14096320ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:23.220481 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:23.234665 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee3cd9-e3ed-4da3-bef6-c14096320ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:23.236786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee3cd9-e3ed-4da3-bef6-c14096320ef0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:23.241496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:23.355486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 47/93] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:23.360407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65738d-11b7-4849-bfee-03c959954357 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:23.362559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee3cd9-e3ed-4da3-bef6-c14096320ef0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:23.400565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea521fa8-db5d-4290-a9be-4a2cf6105889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:23.401711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea521fa8-db5d-4290-a9be-4a2cf6105889 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:23.402163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea521fa8-db5d-4290-a9be-4a2cf6105889 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:23.402582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea521fa8-db5d-4290-a9be-4a2cf6105889 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:23.405012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea521fa8-db5d-4290-a9be-4a2cf6105889 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:23.406813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea521fa8-db5d-4290-a9be-4a2cf6105889 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:23.409010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 47/94] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:23 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:23.415494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea521fa8-db5d-4290-a9be-4a2cf6105889 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:23.587158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee3cd9-e3ed-4da3-bef6-c14096320ef0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:23.590487 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:23.658132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea521fa8-db5d-4290-a9be-4a2cf6105889 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:23.674196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ebe27-f3d0-47ea-a187-680bf6ad531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:23.675081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ebe27-f3d0-47ea-a187-680bf6ad531a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:23.675675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ebe27-f3d0-47ea-a187-680bf6ad531a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:23.675675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ebe27-f3d0-47ea-a187-680bf6ad531a None admin] PATH_INFO: `/v3/projects/b4d9412ed6014b219292f0a6f646d782` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:23.677025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ebe27-f3d0-47ea-a187-680bf6ad531a None admin] RBAC: Authorizing `identity:get_project(project_id=b4d9412ed6014b219292f0a6f646d782)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:23.678392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ebe27-f3d0-47ea-a187-680bf6ad531a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:23.681099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 48/95] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:23 2022] GET /identity/v3/projects/b4d9412ed6014b219292f0a6f646d782 => generated 312 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:23.685784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ebe27-f3d0-47ea-a187-680bf6ad531a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:23.718506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:23.729001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e74c0-fe7f-44f1-837d-1af90284c103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:23.729975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e74c0-fe7f-44f1-837d-1af90284c103 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:23.730459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e74c0-fe7f-44f1-837d-1af90284c103 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:23.730957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e74c0-fe7f-44f1-837d-1af90284c103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:23.732019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e74c0-fe7f-44f1-837d-1af90284c103 None admin] RBAC: Adding query filter params (role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=b2ac89cfedcc4836b5603444826c7753, user.id=c5bb8b07d7ca43fca8f1f46e762df820) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:23.732530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e74c0-fe7f-44f1-837d-1af90284c103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:23.734216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e74c0-fe7f-44f1-837d-1af90284c103 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:23.747239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 48/96] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:23 2022] GET /identity/v3/role_assignments?user.id=c5bb8b07d7ca43fca8f1f46e762df820&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:23.882760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ebe27-f3d0-47ea-a187-680bf6ad531a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:23.939329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed72a3c-229d-46ec-a77a-3373bce62903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:23.940020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72a3c-229d-46ec-a77a-3373bce62903 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:23.940308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72a3c-229d-46ec-a77a-3373bce62903 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:23.940590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72a3c-229d-46ec-a77a-3373bce62903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:23.941455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed72a3c-229d-46ec-a77a-3373bce62903 None admin] RBAC: Adding query filter params (role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=b4d9412ed6014b219292f0a6f646d782, user.id=c5bb8b07d7ca43fca8f1f46e762df820) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:23.941795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed72a3c-229d-46ec-a77a-3373bce62903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:23.943279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed72a3c-229d-46ec-a77a-3373bce62903 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:23.949603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 49/97] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:23 2022] GET /identity/v3/role_assignments?user.id=c5bb8b07d7ca43fca8f1f46e762df820&scope.project.id=b4d9412ed6014b219292f0a6f646d782&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:25.236989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315e3f-f448-49f8-b6a3-88f17c219681 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.238084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315e3f-f448-49f8-b6a3-88f17c219681 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.238580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315e3f-f448-49f8-b6a3-88f17c219681 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.240171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 49/98] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:25.245785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5dda1-bfa7-4bb1-864e-392ea9fb0c2f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.246674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5dda1-bfa7-4bb1-864e-392ea9fb0c2f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.247157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5dda1-bfa7-4bb1-864e-392ea9fb0c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.278552 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e2e5dda1-bfa7-4bb1-864e-392ea9fb0c2f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:25.280114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e2e5dda1-bfa7-4bb1-864e-392ea9fb0c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:25.317671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:25.372130 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 50/99] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:25.408465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6315e3f-f448-49f8-b6a3-88f17c219681 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:25.555283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6315e3f-f448-49f8-b6a3-88f17c219681 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:25.556527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481094-ec83-43f9-9012-d1f44be8823b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.557068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481094-ec83-43f9-9012-d1f44be8823b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.557626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481094-ec83-43f9-9012-d1f44be8823b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.559232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 51/100] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:25.566115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740df009-f4f1-494b-a9c0-b11429439275 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.566737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740df009-f4f1-494b-a9c0-b11429439275 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.567216 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740df009-f4f1-494b-a9c0-b11429439275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.584569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-740df009-f4f1-494b-a9c0-b11429439275 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:25.586148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-740df009-f4f1-494b-a9c0-b11429439275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:25.607585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d9b01-4516-46ab-926f-c1eaadb8e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:25.608401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d9b01-4516-46ab-926f-c1eaadb8e246 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.608684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d9b01-4516-46ab-926f-c1eaadb8e246 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.608959 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d9b01-4516-46ab-926f-c1eaadb8e246 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.633333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d9b01-4516-46ab-926f-c1eaadb8e246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b77d9b01-4516-46ab-926f-c1eaadb8e246 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:25.644161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:25.645121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:25.646361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 50/101] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:25.651065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d9b01-4516-46ab-926f-c1eaadb8e246 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:25.743138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 52/102] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:25.744969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7865-ef0c-48f8-af12-dbc6925be108 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.745505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7865-ef0c-48f8-af12-dbc6925be108 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.745963 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c7865-ef0c-48f8-af12-dbc6925be108 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.747577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 53/103] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:25.748888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b525f00-d3a1-4909-968d-fb34750699e9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.753616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b525f00-d3a1-4909-968d-fb34750699e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.754286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b525f00-d3a1-4909-968d-fb34750699e9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.755083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:25.758007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 54/104] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:25.759480 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d391ed1-4c2f-4ae9-963a-d979c87550c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.759986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d391ed1-4c2f-4ae9-963a-d979c87550c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.760470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d391ed1-4c2f-4ae9-963a-d979c87550c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.786625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9d391ed1-4c2f-4ae9-963a-d979c87550c0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:25.787846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9d391ed1-4c2f-4ae9-963a-d979c87550c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:25.815424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d9b01-4516-46ab-926f-c1eaadb8e246 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:25.864563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3c13f-0953-488f-bc44-48460f774784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:25.865528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3c13f-0953-488f-bc44-48460f774784 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.865985 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3c13f-0953-488f-bc44-48460f774784 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.866411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3c13f-0953-488f-bc44-48460f774784 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.867326 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3c13f-0953-488f-bc44-48460f774784 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:25.867796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3c13f-0953-488f-bc44-48460f774784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:25.869684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3c13f-0953-488f-bc44-48460f774784 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:25.870491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 55/105] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:25.874218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feea273-772f-4817-b4fb-779f234887a7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:25.874673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feea273-772f-4817-b4fb-779f234887a7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:25.875189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feea273-772f-4817-b4fb-779f234887a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:25.887818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 51/106] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:25.889777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3c13f-0953-488f-bc44-48460f774784 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:25.913584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0feea273-772f-4817-b4fb-779f234887a7 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:25.915261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0feea273-772f-4817-b4fb-779f234887a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:25.944654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:26.024454 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 56/107] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:26.025630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feea273-772f-4817-b4fb-779f234887a7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:26.030170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3c13f-0953-488f-bc44-48460f774784 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:26.069171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:26.089664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76aca-61eb-43b5-9dba-d0ec206eb724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:26.090840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76aca-61eb-43b5-9dba-d0ec206eb724 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:26.091334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76aca-61eb-43b5-9dba-d0ec206eb724 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:26.091827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76aca-61eb-43b5-9dba-d0ec206eb724 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:26.093239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76aca-61eb-43b5-9dba-d0ec206eb724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:26.095221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e76aca-61eb-43b5-9dba-d0ec206eb724 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:26.097103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 52/108] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:26.098124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76aca-61eb-43b5-9dba-d0ec206eb724 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:26.170952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feea273-772f-4817-b4fb-779f234887a7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:26.208850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2b4a-fde1-4091-8a7d-0132047f6524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:26.210106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2b4a-fde1-4091-8a7d-0132047f6524 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:26.210591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2b4a-fde1-4091-8a7d-0132047f6524 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:26.211074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2b4a-fde1-4091-8a7d-0132047f6524 None admin] PATH_INFO: `/v3/users/a4a4a555e5ab456db8500c3d674c9a9f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:26.216384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76aca-61eb-43b5-9dba-d0ec206eb724 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:26.225966 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d2b4a-fde1-4091-8a7d-0132047f6524 None admin] RBAC: Authorizing `identity:get_user(user_id=a4a4a555e5ab456db8500c3d674c9a9f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:26.227713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d2b4a-fde1-4091-8a7d-0132047f6524 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:26.229757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 57/109] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:26 2022] GET /identity/v3/users/a4a4a555e5ab456db8500c3d674c9a9f => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:26.230728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2b4a-fde1-4091-8a7d-0132047f6524 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:26.246974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:26.259086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93970-76c1-4d99-88f8-85f613a8f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:26.260068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93970-76c1-4d99-88f8-85f613a8f2bf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:26.260489 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93970-76c1-4d99-88f8-85f613a8f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:26.260783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93970-76c1-4d99-88f8-85f613a8f2bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:26.275449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c93970-76c1-4d99-88f8-85f613a8f2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-76c93970-76c1-4d99-88f8-85f613a8f2bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:26.285400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:26.286315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:26.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 53/110] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:26.287741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93970-76c1-4d99-88f8-85f613a8f2bf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:26.353991 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2b4a-fde1-4091-8a7d-0132047f6524 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:26.354292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:26.396577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e778f38-ab8f-4a17-b0ed-37051defc524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:26.397818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e778f38-ab8f-4a17-b0ed-37051defc524 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:26.398316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e778f38-ab8f-4a17-b0ed-37051defc524 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:26.398800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e778f38-ab8f-4a17-b0ed-37051defc524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:26.411773 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e778f38-ab8f-4a17-b0ed-37051defc524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6e778f38-ab8f-4a17-b0ed-37051defc524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:26.420072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:26.421502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:26.422505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:26.424933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 58/111] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 14:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:26.425980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e778f38-ab8f-4a17-b0ed-37051defc524 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:26.433109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93970-76c1-4d99-88f8-85f613a8f2bf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:26.484560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bba82-ad0e-460f-a816-387a9abf927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:26.485886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bba82-ad0e-460f-a816-387a9abf927c None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:26.486181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bba82-ad0e-460f-a816-387a9abf927c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:26.486471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bba82-ad0e-460f-a816-387a9abf927c None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:26.487903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bba82-ad0e-460f-a816-387a9abf927c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:26.489767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bba82-ad0e-460f-a816-387a9abf927c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:26.507604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:26.529561 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 54/112] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 14:59:26 2022] POST /identity/v3/projects => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:26.530472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bba82-ad0e-460f-a816-387a9abf927c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:26.556111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e778f38-ab8f-4a17-b0ed-37051defc524 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:26.613417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e06bf-5af6-41df-8ffd-778d770490aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:26.614122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e06bf-5af6-41df-8ffd-778d770490aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:26.615103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e06bf-5af6-41df-8ffd-778d770490aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:26.615473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e06bf-5af6-41df-8ffd-778d770490aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:26.686764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:26.694389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bba82-ad0e-460f-a816-387a9abf927c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:26.722226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e06bf-5af6-41df-8ffd-778d770490aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:26.724339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e06bf-5af6-41df-8ffd-778d770490aa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:26.761349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42cf3c-f324-4033-9491-e297722c31a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:26.762173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42cf3c-f324-4033-9491-e297722c31a9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:26.762528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42cf3c-f324-4033-9491-e297722c31a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:26.762881 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42cf3c-f324-4033-9491-e297722c31a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:26.763706 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42cf3c-f324-4033-9491-e297722c31a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:26.764838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42cf3c-f324-4033-9491-e297722c31a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:26.767051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42cf3c-f324-4033-9491-e297722c31a9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:26.781497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 55/113] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:26.781497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42cf3c-f324-4033-9491-e297722c31a9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:26.825691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:26.863103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 59/114] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:26.864137 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e06bf-5af6-41df-8ffd-778d770490aa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:26.900903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42cf3c-f324-4033-9491-e297722c31a9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:26.955780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35a386-87e9-4ac9-a28b-b8bded10fef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:26.957232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35a386-87e9-4ac9-a28b-b8bded10fef9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:26.957765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35a386-87e9-4ac9-a28b-b8bded10fef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:26.958335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35a386-87e9-4ac9-a28b-b8bded10fef9 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:26.959295 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35a386-87e9-4ac9-a28b-b8bded10fef9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:26.959926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35a386-87e9-4ac9-a28b-b8bded10fef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:26.961687 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35a386-87e9-4ac9-a28b-b8bded10fef9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:26.972065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 56/115] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:26.973347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35a386-87e9-4ac9-a28b-b8bded10fef9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:26.986082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e06bf-5af6-41df-8ffd-778d770490aa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:27.022934 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7309b2-e488-47cc-a555-c1ac2469d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:27.023885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7309b2-e488-47cc-a555-c1ac2469d4fb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.024244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7309b2-e488-47cc-a555-c1ac2469d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.024596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7309b2-e488-47cc-a555-c1ac2469d4fb None admin] PATH_INFO: `/v3/users/c5bb8b07d7ca43fca8f1f46e762df820` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.026041 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7309b2-e488-47cc-a555-c1ac2469d4fb None admin] RBAC: Authorizing `identity:get_user(user_id=c5bb8b07d7ca43fca8f1f46e762df820)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:27.027741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7309b2-e488-47cc-a555-c1ac2469d4fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:27.029791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 60/116] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:26 2022] GET /identity/v3/users/c5bb8b07d7ca43fca8f1f46e762df820 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:27.030045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:27.031113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21b792-b328-4be6-bf5a-94a22d28c0b7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.032711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21b792-b328-4be6-bf5a-94a22d28c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.032711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21b792-b328-4be6-bf5a-94a22d28c0b7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.033650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 61/117] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:27.034487 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21b792-b328-4be6-bf5a-94a22d28c0b7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:27.081858 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:27.099565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35a386-87e9-4ac9-a28b-b8bded10fef9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:27.138504 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb9698-adc1-4a8d-8c8b-7211c4f3a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:27.139852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb9698-adc1-4a8d-8c8b-7211c4f3a723 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.140352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb9698-adc1-4a8d-8c8b-7211c4f3a723 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.141720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb9698-adc1-4a8d-8c8b-7211c4f3a723 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.143378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb9698-adc1-4a8d-8c8b-7211c4f3a723 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:27.145264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb9698-adc1-4a8d-8c8b-7211c4f3a723 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:27.147518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 57/118] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:26 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:27.147761 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21b792-b328-4be6-bf5a-94a22d28c0b7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:27.148972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cbe44-0a0e-4277-8ca4-ca6b74d5d309 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.149396 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cbe44-0a0e-4277-8ca4-ca6b74d5d309 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.149693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cbe44-0a0e-4277-8ca4-ca6b74d5d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.167425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2c3cbe44-0a0e-4277-8ca4-ca6b74d5d309 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:27.168623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c3cbe44-0a0e-4277-8ca4-ca6b74d5d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:27.185750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031d67c-0f5e-4c4b-bee2-d61a37d098f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:27.186493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031d67c-0f5e-4c4b-bee2-d61a37d098f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.186976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031d67c-0f5e-4c4b-bee2-d61a37d098f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.187236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031d67c-0f5e-4c4b-bee2-d61a37d098f6 None admin] PATH_INFO: `/v3/users/942b864bb91e4374a593803fb944209b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.188641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031d67c-0f5e-4c4b-bee2-d61a37d098f6 None admin] RBAC: Authorizing `identity:get_user(user_id=942b864bb91e4374a593803fb944209b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:27.190400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031d67c-0f5e-4c4b-bee2-d61a37d098f6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:27.196068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 62/119] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:27 2022] GET /identity/v3/users/942b864bb91e4374a593803fb944209b => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:27.196068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031d67c-0f5e-4c4b-bee2-d61a37d098f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:27.250478 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 58/120] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:27.251688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38269b5e-732a-479a-9f31-5ddaee8487e1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.252049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38269b5e-732a-479a-9f31-5ddaee8487e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.252408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38269b5e-732a-479a-9f31-5ddaee8487e1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.257552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 59/121] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:27.257552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38269b5e-732a-479a-9f31-5ddaee8487e1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:27.285231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:27.313364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031d67c-0f5e-4c4b-bee2-d61a37d098f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:27.323825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:27.352525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8aec1-9cc3-4587-84c2-69a7706582ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:27.353398 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8aec1-9cc3-4587-84c2-69a7706582ce None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.353735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8aec1-9cc3-4587-84c2-69a7706582ce None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.354019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8aec1-9cc3-4587-84c2-69a7706582ce None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.355218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8aec1-9cc3-4587-84c2-69a7706582ce None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:27.356683 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8aec1-9cc3-4587-84c2-69a7706582ce None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:27.358570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 63/122] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:27 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:27.360049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8aec1-9cc3-4587-84c2-69a7706582ce None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:27.372903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38269b5e-732a-479a-9f31-5ddaee8487e1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:27.411276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9639031-4aa1-4dba-9a23-7d9aa31e305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:27.411852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9639031-4aa1-4dba-9a23-7d9aa31e305a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.412137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9639031-4aa1-4dba-9a23-7d9aa31e305a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.412417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9639031-4aa1-4dba-9a23-7d9aa31e305a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.413255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9639031-4aa1-4dba-9a23-7d9aa31e305a None admin] RBAC: Adding query filter params (role.id=8ac3052831b845bc88d5e829f84cb382, scope.project.id=b2ac89cfedcc4836b5603444826c7753, user.id=a4a4a555e5ab456db8500c3d674c9a9f) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:27.413597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9639031-4aa1-4dba-9a23-7d9aa31e305a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:27.415066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9639031-4aa1-4dba-9a23-7d9aa31e305a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:27.429506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 60/123] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:27 2022] GET /identity/v3/role_assignments?user.id=a4a4a555e5ab456db8500c3d674c9a9f&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=8ac3052831b845bc88d5e829f84cb382 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:27.429506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d73476-d7f6-4f07-b20a-f1d5e4908c67 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.429506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d73476-d7f6-4f07-b20a-f1d5e4908c67 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.429506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d73476-d7f6-4f07-b20a-f1d5e4908c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.451218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-89d73476-d7f6-4f07-b20a-f1d5e4908c67 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:27.453879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89d73476-d7f6-4f07-b20a-f1d5e4908c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:27.504029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8aec1-9cc3-4587-84c2-69a7706582ce None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:27.551509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 61/124] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:27.552382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d73476-d7f6-4f07-b20a-f1d5e4908c67 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:27.558938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890170b-76e2-44d5-b657-386ec2e2da0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:27.559813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890170b-76e2-44d5-b657-386ec2e2da0a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.560106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890170b-76e2-44d5-b657-386ec2e2da0a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.560492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890170b-76e2-44d5-b657-386ec2e2da0a None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.562296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890170b-76e2-44d5-b657-386ec2e2da0a None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:27.565423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890170b-76e2-44d5-b657-386ec2e2da0a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:27.567542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 64/125] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:27 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:27.568645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890170b-76e2-44d5-b657-386ec2e2da0a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:27.574223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:27.633626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:27.675356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d73476-d7f6-4f07-b20a-f1d5e4908c67 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:27.712801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890170b-76e2-44d5-b657-386ec2e2da0a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:27.715012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f55c2-daf6-42eb-961c-3ed41633ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:27.715956 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f55c2-daf6-42eb-961c-3ed41633ed82 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.716297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f55c2-daf6-42eb-961c-3ed41633ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.716651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f55c2-daf6-42eb-961c-3ed41633ed82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.728502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f55c2-daf6-42eb-961c-3ed41633ed82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-036f55c2-daf6-42eb-961c-3ed41633ed82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:27.737255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:27.738217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:27.739001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 62/126] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 14:59:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:27.739654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f55c2-daf6-42eb-961c-3ed41633ed82 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:27.784886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d906f57-4e6f-423a-98dc-092a1d83663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:27.785823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d906f57-4e6f-423a-98dc-092a1d83663a None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:27.786107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d906f57-4e6f-423a-98dc-092a1d83663a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:27.786384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d906f57-4e6f-423a-98dc-092a1d83663a None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753/users/c5bb8b07d7ca43fca8f1f46e762df820/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:27.788412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d906f57-4e6f-423a-98dc-092a1d83663a None admin] RBAC: Authorizing `identity:create_grant(project_id=b2ac89cfedcc4836b5603444826c7753, user_id=c5bb8b07d7ca43fca8f1f46e762df820, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:27.789887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d906f57-4e6f-423a-98dc-092a1d83663a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:27.811373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 65/127] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 14:59:27 2022] PUT /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753/users/c5bb8b07d7ca43fca8f1f46e762df820/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:27.812508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d906f57-4e6f-423a-98dc-092a1d83663a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:27.901947 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:27.962821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d906f57-4e6f-423a-98dc-092a1d83663a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:27.966514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:27.975752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f55c2-daf6-42eb-961c-3ed41633ed82 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:28.006634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4204-8573-44a8-b43f-e916bd91f76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:28.007618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4204-8573-44a8-b43f-e916bd91f76f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:28.009196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4204-8573-44a8-b43f-e916bd91f76f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:28.009196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4204-8573-44a8-b43f-e916bd91f76f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:28.021195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd4204-8573-44a8-b43f-e916bd91f76f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-edbd4204-8573-44a8-b43f-e916bd91f76f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:28.029684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:28.030794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:28.032994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:28.036124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 66/128] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:28.036124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4204-8573-44a8-b43f-e916bd91f76f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:28.056672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b564845-1abe-419f-8ae7-7efc8d4ea4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:28.057916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b564845-1abe-419f-8ae7-7efc8d4ea4fb None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:28.058372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b564845-1abe-419f-8ae7-7efc8d4ea4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:28.058801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b564845-1abe-419f-8ae7-7efc8d4ea4fb None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753/users/942b864bb91e4374a593803fb944209b/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:28.061055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b564845-1abe-419f-8ae7-7efc8d4ea4fb None admin] RBAC: Authorizing `identity:create_grant(project_id=b2ac89cfedcc4836b5603444826c7753, user_id=942b864bb91e4374a593803fb944209b, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:28.063586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b564845-1abe-419f-8ae7-7efc8d4ea4fb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:28.097452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 63/129] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 14:59:27 2022] PUT /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753/users/942b864bb91e4374a593803fb944209b/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:28.098551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b564845-1abe-419f-8ae7-7efc8d4ea4fb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:28.238930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b564845-1abe-419f-8ae7-7efc8d4ea4fb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:28.249318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4204-8573-44a8-b43f-e916bd91f76f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:28.283163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9a06-b3b5-4afd-9187-f86065badb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:28.284009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9a06-b3b5-4afd-9187-f86065badb88 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:28.284907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9a06-b3b5-4afd-9187-f86065badb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:28.285297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc9a06-b3b5-4afd-9187-f86065badb88 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:28.286381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc9a06-b3b5-4afd-9187-f86065badb88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:28.288727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc9a06-b3b5-4afd-9187-f86065badb88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:28.288727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc9a06-b3b5-4afd-9187-f86065badb88 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:28.300379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 64/130] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:28.300778 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:28.306235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9a06-b3b5-4afd-9187-f86065badb88 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:28.358236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd664-317c-4439-a83f-777bbcefb3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:28.358982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd664-317c-4439-a83f-777bbcefb3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:28.359907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd664-317c-4439-a83f-777bbcefb3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:28.360890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd664-317c-4439-a83f-777bbcefb3e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:28.361788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccd664-317c-4439-a83f-777bbcefb3e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:28.362171 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccd664-317c-4439-a83f-777bbcefb3e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:28.363613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccd664-317c-4439-a83f-777bbcefb3e6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:28.385565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 67/131] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 14:59:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:28.393814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd664-317c-4439-a83f-777bbcefb3e6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:28.426990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc9a06-b3b5-4afd-9187-f86065badb88 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:28.466211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e921e-7972-47cd-9f26-40161a8b7e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:28.467526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e921e-7972-47cd-9f26-40161a8b7e5b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:28.467817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e921e-7972-47cd-9f26-40161a8b7e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:28.468099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e921e-7972-47cd-9f26-40161a8b7e5b None admin] PATH_INFO: `/v3/users/c5bb8b07d7ca43fca8f1f46e762df820` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:28.469665 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e921e-7972-47cd-9f26-40161a8b7e5b None admin] RBAC: Authorizing `identity:get_user(user_id=c5bb8b07d7ca43fca8f1f46e762df820)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:28.471330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e921e-7972-47cd-9f26-40161a8b7e5b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:28.473235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 65/132] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:28 2022] GET /identity/v3/users/c5bb8b07d7ca43fca8f1f46e762df820 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:28.478311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e921e-7972-47cd-9f26-40161a8b7e5b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:28.482233 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:28.551020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:28.593386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e921e-7972-47cd-9f26-40161a8b7e5b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:28.633980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1c78-484e-4dfb-bee2-b53bf0be9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:28.634854 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1c78-484e-4dfb-bee2-b53bf0be9323 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:28.635629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1c78-484e-4dfb-bee2-b53bf0be9323 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:28.635921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1c78-484e-4dfb-bee2-b53bf0be9323 None admin] PATH_INFO: `/v3/projects/b4d9412ed6014b219292f0a6f646d782` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:28.637163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1c78-484e-4dfb-bee2-b53bf0be9323 None admin] RBAC: Authorizing `identity:get_project(project_id=b4d9412ed6014b219292f0a6f646d782)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:28.639075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1c78-484e-4dfb-bee2-b53bf0be9323 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:28.641758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 66/133] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:28 2022] GET /identity/v3/projects/b4d9412ed6014b219292f0a6f646d782 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:28.647840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1c78-484e-4dfb-bee2-b53bf0be9323 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:28.702434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd664-317c-4439-a83f-777bbcefb3e6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:28.813075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad004b5-4834-441b-a0a6-f6f57155fde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:28.814509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad004b5-4834-441b-a0a6-f6f57155fde9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:28.814816 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad004b5-4834-441b-a0a6-f6f57155fde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:28.815098 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad004b5-4834-441b-a0a6-f6f57155fde9 None admin] PATH_INFO: `/v3/users/c5bb8b07d7ca43fca8f1f46e762df820` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:28.818555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1c78-484e-4dfb-bee2-b53bf0be9323 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:28.822306 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad004b5-4834-441b-a0a6-f6f57155fde9 None admin] RBAC: Authorizing `identity:get_user(user_id=c5bb8b07d7ca43fca8f1f46e762df820)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:28.824163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad004b5-4834-441b-a0a6-f6f57155fde9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:28.825695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 68/134] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:28 2022] GET /identity/v3/users/c5bb8b07d7ca43fca8f1f46e762df820 => generated 275 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:28.834660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad004b5-4834-441b-a0a6-f6f57155fde9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:28.885866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:28.894332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56deff-8a53-4d3f-ab70-922dac661c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:28.896475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56deff-8a53-4d3f-ab70-922dac661c09 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:28.896974 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56deff-8a53-4d3f-ab70-922dac661c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:28.897466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56deff-8a53-4d3f-ab70-922dac661c09 None admin] PATH_INFO: `/v3/projects/b4d9412ed6014b219292f0a6f646d782/users/c5bb8b07d7ca43fca8f1f46e762df820/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:28.901521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56deff-8a53-4d3f-ab70-922dac661c09 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4d9412ed6014b219292f0a6f646d782, user_id=c5bb8b07d7ca43fca8f1f46e762df820, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:28.904756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56deff-8a53-4d3f-ab70-922dac661c09 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:28.950428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 67/135] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 14:59:28 2022] PUT /identity/v3/projects/b4d9412ed6014b219292f0a6f646d782/users/c5bb8b07d7ca43fca8f1f46e762df820/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 14:59:29.024515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:29.032440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad004b5-4834-441b-a0a6-f6f57155fde9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:29.074224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95e708-e87e-4be7-b32f-864be724cc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:29.075020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e708-e87e-4be7-b32f-864be724cc2d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:29.075303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e708-e87e-4be7-b32f-864be724cc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:29.075578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e708-e87e-4be7-b32f-864be724cc2d None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:29.076799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95e708-e87e-4be7-b32f-864be724cc2d None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:29.078332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95e708-e87e-4be7-b32f-864be724cc2d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:29.080191 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 69/136] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:28 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:29.085981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56deff-8a53-4d3f-ab70-922dac661c09 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:29.200623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166d0b-3c06-4360-b59e-b92f6656ae94 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:29.200938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166d0b-3c06-4360-b59e-b92f6656ae94 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:29.201187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89166d0b-3c06-4360-b59e-b92f6656ae94 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:29.202779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 70/137] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:29.210268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c62c7-22f7-4279-aac4-bc7a0cb09bff None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:29.210566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c62c7-22f7-4279-aac4-bc7a0cb09bff None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:29.210827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c62c7-22f7-4279-aac4-bc7a0cb09bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:29.236077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56deff-8a53-4d3f-ab70-922dac661c09 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:29.238491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f84c62c7-22f7-4279-aac4-bc7a0cb09bff None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:29.240639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f84c62c7-22f7-4279-aac4-bc7a0cb09bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:29.309748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafeefe-e14a-4b08-885f-c8d369cb48f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:29.311242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafeefe-e14a-4b08-885f-c8d369cb48f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:29.311531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafeefe-e14a-4b08-885f-c8d369cb48f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:29.312111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafeefe-e14a-4b08-885f-c8d369cb48f5 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753/users/c5bb8b07d7ca43fca8f1f46e762df820/roles/b1558d27591d4ee3b4070a19333d6180` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:29.322764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafeefe-e14a-4b08-885f-c8d369cb48f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2ac89cfedcc4836b5603444826c7753, user_id=c5bb8b07d7ca43fca8f1f46e762df820, role_id=b1558d27591d4ee3b4070a19333d6180)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:29.324402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafeefe-e14a-4b08-885f-c8d369cb48f5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:29.350813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 68/138] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 14:59:29 2022] PUT /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753/users/c5bb8b07d7ca43fca8f1f46e762df820/roles/b1558d27591d4ee3b4070a19333d6180 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:29.369026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 71/139] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:29.398796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafeefe-e14a-4b08-885f-c8d369cb48f5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:29.462544 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:29.539205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafeefe-e14a-4b08-885f-c8d369cb48f5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:29.591907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426f05d-bf08-4146-8b17-3799bb206d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:29.592645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f05d-bf08-4146-8b17-3799bb206d22 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:29.593127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f05d-bf08-4146-8b17-3799bb206d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:29.593410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f05d-bf08-4146-8b17-3799bb206d22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:29.595800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426f05d-bf08-4146-8b17-3799bb206d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:29.597267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426f05d-bf08-4146-8b17-3799bb206d22 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:29.598933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 69/140] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:29.604785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c62c7-22f7-4279-aac4-bc7a0cb09bff None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:29.708455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:29.719202 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c62c7-22f7-4279-aac4-bc7a0cb09bff None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:29.755465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21944513-324d-4743-8e98-a8500c58b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:29.756212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21944513-324d-4743-8e98-a8500c58b45b None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:29.756502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21944513-324d-4743-8e98-a8500c58b45b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:29.756783 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21944513-324d-4743-8e98-a8500c58b45b None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:29.757591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21944513-324d-4743-8e98-a8500c58b45b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:29.759093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21944513-324d-4743-8e98-a8500c58b45b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:29.786770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 72/141] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 14:59:29 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:30.518101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d5c7-2447-45b4-8fba-d1b97c19d349 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:30.518613 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d5c7-2447-45b4-8fba-d1b97c19d349 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:30.518711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d5c7-2447-45b4-8fba-d1b97c19d349 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:30.520098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 70/142] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:30.530470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5c1d5-1ed8-4d21-8586-927f3e65ba4b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:30.530973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5c1d5-1ed8-4d21-8586-927f3e65ba4b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:30.531186 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5c1d5-1ed8-4d21-8586-927f3e65ba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:30.552448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6bc5c1d5-1ed8-4d21-8586-927f3e65ba4b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:30.553668 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6bc5c1d5-1ed8-4d21-8586-927f3e65ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:30.639046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 73/143] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:30.679151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5d5c7-2447-45b4-8fba-d1b97c19d349 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:30.805732 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5d5c7-2447-45b4-8fba-d1b97c19d349 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:30.837807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:30.857794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998abbe2-c1d7-43dd-9376-d3d9f0f51767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:30.858614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998abbe2-c1d7-43dd-9376-d3d9f0f51767 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:30.858906 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998abbe2-c1d7-43dd-9376-d3d9f0f51767 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:30.859320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998abbe2-c1d7-43dd-9376-d3d9f0f51767 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:30.871503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998abbe2-c1d7-43dd-9376-d3d9f0f51767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-998abbe2-c1d7-43dd-9376-d3d9f0f51767 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:30.884902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:30.885865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:30.887076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 71/144] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:30.892510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5c1d5-1ed8-4d21-8586-927f3e65ba4b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:31.020601 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:31.056323 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5c1d5-1ed8-4d21-8586-927f3e65ba4b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:31.096374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c428d1-9e46-4264-bbc9-10a4b5549ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:31.097057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c428d1-9e46-4264-bbc9-10a4b5549ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:31.097342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c428d1-9e46-4264-bbc9-10a4b5549ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:31.097793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c428d1-9e46-4264-bbc9-10a4b5549ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:31.098566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c428d1-9e46-4264-bbc9-10a4b5549ee0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:31.098878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c428d1-9e46-4264-bbc9-10a4b5549ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:31.100273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c428d1-9e46-4264-bbc9-10a4b5549ee0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:31.104691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd9fb-2ade-4ca7-bca3-69dadcb9af3f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:31.105261 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd9fb-2ade-4ca7-bca3-69dadcb9af3f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:31.105816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd9fb-2ade-4ca7-bca3-69dadcb9af3f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:31.107427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 72/145] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:31.112671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 74/146] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:31.118782 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03f34e-ddaf-4720-8ae7-65853b9ddbd8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:31.118939 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c428d1-9e46-4264-bbc9-10a4b5549ee0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:31.119584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03f34e-ddaf-4720-8ae7-65853b9ddbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:31.120100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03f34e-ddaf-4720-8ae7-65853b9ddbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:31.147253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0f03f34e-ddaf-4720-8ae7-65853b9ddbd8 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:31.148867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0f03f34e-ddaf-4720-8ae7-65853b9ddbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:31.230642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c428d1-9e46-4264-bbc9-10a4b5549ee0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:31.269319 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af2506-0a1f-4412-b69e-3690efba74fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:31.270233 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af2506-0a1f-4412-b69e-3690efba74fa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:31.270520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af2506-0a1f-4412-b69e-3690efba74fa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:31.270801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af2506-0a1f-4412-b69e-3690efba74fa None admin] PATH_INFO: `/v3/users/a4a4a555e5ab456db8500c3d674c9a9f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:31.272029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af2506-0a1f-4412-b69e-3690efba74fa None admin] RBAC: Authorizing `identity:get_user(user_id=a4a4a555e5ab456db8500c3d674c9a9f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:31.273500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af2506-0a1f-4412-b69e-3690efba74fa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:31.275686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 75/147] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:31 2022] GET /identity/v3/users/a4a4a555e5ab456db8500c3d674c9a9f => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:31.276989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b92b4-1b22-4b57-9891-7c39b1abde49 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:31.277283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b92b4-1b22-4b57-9891-7c39b1abde49 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:31.277698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b92b4-1b22-4b57-9891-7c39b1abde49 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:31.279227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 76/148] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:31.285984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f81c0-98cd-48da-8b4d-261e7f0d7842 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:31.286272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f81c0-98cd-48da-8b4d-261e7f0d7842 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:31.286550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f81c0-98cd-48da-8b4d-261e7f0d7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:31.311463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 73/149] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:31.313052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03f34e-ddaf-4720-8ae7-65853b9ddbd8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:31.320181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-273f81c0-98cd-48da-8b4d-261e7f0d7842 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:31.322574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-273f81c0-98cd-48da-8b4d-261e7f0d7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:31.325063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:31.451806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 77/150] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:31.452580 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f81c0-98cd-48da-8b4d-261e7f0d7842 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:31.487784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03f34e-ddaf-4720-8ae7-65853b9ddbd8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:31.509206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:31.568673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306a4ed-38cc-4eb2-a634-93baf51ecb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:31.574363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306a4ed-38cc-4eb2-a634-93baf51ecb13 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:31.574857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306a4ed-38cc-4eb2-a634-93baf51ecb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:31.575336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306a4ed-38cc-4eb2-a634-93baf51ecb13 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:31.577822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306a4ed-38cc-4eb2-a634-93baf51ecb13 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:31.580727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306a4ed-38cc-4eb2-a634-93baf51ecb13 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:31.582842 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 74/151] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:31 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:31.585062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306a4ed-38cc-4eb2-a634-93baf51ecb13 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:31.697612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f81c0-98cd-48da-8b4d-261e7f0d7842 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:31.774401 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cafa0c-f20b-4680-bbea-02180c035507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:31.775544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cafa0c-f20b-4680-bbea-02180c035507 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:31.775999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cafa0c-f20b-4680-bbea-02180c035507 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:31.776453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cafa0c-f20b-4680-bbea-02180c035507 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:31.797987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:31.808974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cafa0c-f20b-4680-bbea-02180c035507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-05cafa0c-f20b-4680-bbea-02180c035507 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:31.818842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:31.819728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:31.820523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:31.828742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 78/152] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 14:59:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:31.830363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cafa0c-f20b-4680-bbea-02180c035507 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:31.839482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306a4ed-38cc-4eb2-a634-93baf51ecb13 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:31.922867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d998f3-f9e9-43be-a4d8-e973f73a0722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:31.924182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d998f3-f9e9-43be-a4d8-e973f73a0722 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:31.924465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d998f3-f9e9-43be-a4d8-e973f73a0722 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:31.924742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d998f3-f9e9-43be-a4d8-e973f73a0722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:31.955532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d998f3-f9e9-43be-a4d8-e973f73a0722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d1d998f3-f9e9-43be-a4d8-e973f73a0722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:31.970006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:31.971028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:31.971816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 75/153] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:31.972600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d998f3-f9e9-43be-a4d8-e973f73a0722 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:32.080620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:32.135664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cafa0c-f20b-4680-bbea-02180c035507 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:32.213760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d998f3-f9e9-43be-a4d8-e973f73a0722 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:32.242920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f156433-5a3f-4f48-ba73-bc4c673d5c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:32.244056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f156433-5a3f-4f48-ba73-bc4c673d5c7c None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:32.244481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f156433-5a3f-4f48-ba73-bc4c673d5c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:32.244892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f156433-5a3f-4f48-ba73-bc4c673d5c7c None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753/users/a4a4a555e5ab456db8500c3d674c9a9f/roles/8ac3052831b845bc88d5e829f84cb382` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:32.247228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f156433-5a3f-4f48-ba73-bc4c673d5c7c None admin] RBAC: Authorizing `identity:create_grant(project_id=b2ac89cfedcc4836b5603444826c7753, user_id=a4a4a555e5ab456db8500c3d674c9a9f, role_id=8ac3052831b845bc88d5e829f84cb382)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:32.248856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f156433-5a3f-4f48-ba73-bc4c673d5c7c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:32.263545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fcf121-d1c0-4a72-b16f-230763ce1707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:32.264236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcf121-d1c0-4a72-b16f-230763ce1707 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:32.264528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcf121-d1c0-4a72-b16f-230763ce1707 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:32.269956 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fcf121-d1c0-4a72-b16f-230763ce1707 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:32.270826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcf121-d1c0-4a72-b16f-230763ce1707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:32.271158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcf121-d1c0-4a72-b16f-230763ce1707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:32.272621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fcf121-d1c0-4a72-b16f-230763ce1707 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:32.281602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 79/154] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 14:59:31 2022] PUT /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753/users/a4a4a555e5ab456db8500c3d674c9a9f/roles/8ac3052831b845bc88d5e829f84cb382 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:32.282611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f156433-5a3f-4f48-ba73-bc4c673d5c7c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:32.308119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 76/155] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:32.309502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f729d1-09ad-4f4e-8c57-21e111e65106 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:32.309804 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f729d1-09ad-4f4e-8c57-21e111e65106 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:32.310094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f729d1-09ad-4f4e-8c57-21e111e65106 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:32.311397 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 77/156] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:32.315603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f729d1-09ad-4f4e-8c57-21e111e65106 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:32.449263 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:32.508808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:32.520655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f729d1-09ad-4f4e-8c57-21e111e65106 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:32.543467 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f156433-5a3f-4f48-ba73-bc4c673d5c7c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:32.604826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91554820-b8e2-4aaa-b4c6-5603b479dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:32.605747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91554820-b8e2-4aaa-b4c6-5603b479dbfe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:32.606033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91554820-b8e2-4aaa-b4c6-5603b479dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:32.606312 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91554820-b8e2-4aaa-b4c6-5603b479dbfe None admin] PATH_INFO: `/v3/users/942b864bb91e4374a593803fb944209b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:32.607765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91554820-b8e2-4aaa-b4c6-5603b479dbfe None admin] RBAC: Authorizing `identity:get_user(user_id=942b864bb91e4374a593803fb944209b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:32.610430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91554820-b8e2-4aaa-b4c6-5603b479dbfe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:32.612361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 78/157] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:32 2022] GET /identity/v3/users/942b864bb91e4374a593803fb944209b => generated 247 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:32.614097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c68e3-f4e3-4acf-ac0b-eef9e744cdf8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:32.614433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c68e3-f4e3-4acf-ac0b-eef9e744cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:32.614838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c68e3-f4e3-4acf-ac0b-eef9e744cdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:32.628293 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ef874-920a-4366-bdc5-0d26094d6711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:32.629025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ef874-920a-4366-bdc5-0d26094d6711 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:32.629315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ef874-920a-4366-bdc5-0d26094d6711 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:32.629652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ef874-920a-4366-bdc5-0d26094d6711 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:32.630430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ef874-920a-4366-bdc5-0d26094d6711 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:32.630738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ef874-920a-4366-bdc5-0d26094d6711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:32.635482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ef874-920a-4366-bdc5-0d26094d6711 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:32.647364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e37c68e3-f4e3-4acf-ac0b-eef9e744cdf8 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:32.648564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e37c68e3-f4e3-4acf-ac0b-eef9e744cdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:32.655056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 80/158] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:32.658756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ef874-920a-4366-bdc5-0d26094d6711 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:32.801615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 79/159] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:32.802373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c68e3-f4e3-4acf-ac0b-eef9e744cdf8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:32.883585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ef874-920a-4366-bdc5-0d26094d6711 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:32.933238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:32.963911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f779b2-6475-472e-b20a-d776c71d9145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:32.964631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f779b2-6475-472e-b20a-d776c71d9145 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:32.964916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f779b2-6475-472e-b20a-d776c71d9145 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:32.966627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f779b2-6475-472e-b20a-d776c71d9145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:33.028875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:33.036580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c68e3-f4e3-4acf-ac0b-eef9e744cdf8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:33.084756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f779b2-6475-472e-b20a-d776c71d9145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:33.090721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f779b2-6475-472e-b20a-d776c71d9145 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:33.103555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ee848-0974-44be-917f-075d8d127796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:33.104446 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ee848-0974-44be-917f-075d8d127796 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:33.104732 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ee848-0974-44be-917f-075d8d127796 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:33.105013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ee848-0974-44be-917f-075d8d127796 None admin] PATH_INFO: `/v3/users/c5bb8b07d7ca43fca8f1f46e762df820` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:33.110575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ee848-0974-44be-917f-075d8d127796 None admin] RBAC: Authorizing `identity:get_user(user_id=c5bb8b07d7ca43fca8f1f46e762df820)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:33.112069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ee848-0974-44be-917f-075d8d127796 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:33.114654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 80/160] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:32 2022] GET /identity/v3/users/c5bb8b07d7ca43fca8f1f46e762df820 => generated 275 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:33.115480 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ee848-0974-44be-917f-075d8d127796 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:33.263535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 81/161] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:33.264481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f779b2-6475-472e-b20a-d776c71d9145 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:33.302567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:33.306749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ee848-0974-44be-917f-075d8d127796 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:33.345749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c10f-74b5-4a06-b75d-76d4b92425a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:33.347362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c10f-74b5-4a06-b75d-76d4b92425a0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:33.348173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c10f-74b5-4a06-b75d-76d4b92425a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:33.348852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c10f-74b5-4a06-b75d-76d4b92425a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:33.362559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0c10f-74b5-4a06-b75d-76d4b92425a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f2b0c10f-74b5-4a06-b75d-76d4b92425a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:33.371203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:33.372126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:33.372934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:33.375987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 81/162] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:33.377063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c10f-74b5-4a06-b75d-76d4b92425a0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:33.398596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f779b2-6475-472e-b20a-d776c71d9145 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:33.432832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:33.454960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3205bc5-0e36-4010-b527-e9b8378ca018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:33.455627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3205bc5-0e36-4010-b527-e9b8378ca018 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:33.455931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3205bc5-0e36-4010-b527-e9b8378ca018 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:33.456196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3205bc5-0e36-4010-b527-e9b8378ca018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:33.566066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c10f-74b5-4a06-b75d-76d4b92425a0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:33.626804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3205bc5-0e36-4010-b527-e9b8378ca018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:33.628305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3205bc5-0e36-4010-b527-e9b8378ca018 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:33.630333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26f6c-1c27-406f-90a3-f1e9b74f3439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:33.631115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26f6c-1c27-406f-90a3-f1e9b74f3439 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:33.631402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26f6c-1c27-406f-90a3-f1e9b74f3439 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:33.631682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26f6c-1c27-406f-90a3-f1e9b74f3439 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:33.632963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab26f6c-1c27-406f-90a3-f1e9b74f3439 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:33.635118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab26f6c-1c27-406f-90a3-f1e9b74f3439 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:33.636482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 82/163] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:33 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:33.637265 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26f6c-1c27-406f-90a3-f1e9b74f3439 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:33.686046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:33.825104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:33.839627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26f6c-1c27-406f-90a3-f1e9b74f3439 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:33.852044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 82/164] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:33.853793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd70405-14f4-4b73-8639-4a344886528a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:33.854082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd70405-14f4-4b73-8639-4a344886528a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:33.854362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd70405-14f4-4b73-8639-4a344886528a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:33.855826 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 83/165] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:33.856371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd70405-14f4-4b73-8639-4a344886528a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:33.924409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9725a-b910-4bdb-ad40-c7feaf3f2b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:33.925423 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9725a-b910-4bdb-ad40-c7feaf3f2b3c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:33.925955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9725a-b910-4bdb-ad40-c7feaf3f2b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:33.926467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9725a-b910-4bdb-ad40-c7feaf3f2b3c None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:33.933606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9725a-b910-4bdb-ad40-c7feaf3f2b3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:33.934151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9725a-b910-4bdb-ad40-c7feaf3f2b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:33.935958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9725a-b910-4bdb-ad40-c7feaf3f2b3c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:33.955522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 83/166] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:33.957045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94769df1-1ec6-40ae-8096-fe713529b8af None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:33.957287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94769df1-1ec6-40ae-8096-fe713529b8af None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:33.957531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94769df1-1ec6-40ae-8096-fe713529b8af None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:33.958862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 84/167] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:33.959487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94769df1-1ec6-40ae-8096-fe713529b8af None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:34.002081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd70405-14f4-4b73-8639-4a344886528a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:34.024926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:34.042360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bb9f5-383e-4c36-aef8-311ff5b29c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:34.043467 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bb9f5-383e-4c36-aef8-311ff5b29c93 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:34.043970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bb9f5-383e-4c36-aef8-311ff5b29c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:34.044460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bb9f5-383e-4c36-aef8-311ff5b29c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:34.045816 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bb9f5-383e-4c36-aef8-311ff5b29c93 None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=b2ac89cfedcc4836b5603444826c7753, user.id=942b864bb91e4374a593803fb944209b) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:34.046729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bb9f5-383e-4c36-aef8-311ff5b29c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:34.048727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bb9f5-383e-4c36-aef8-311ff5b29c93 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:34.055869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 84/168] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:33 2022] GET /identity/v3/role_assignments?user.id=942b864bb91e4374a593803fb944209b&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:34.057528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d38953-1927-4c22-b99f-7a42baa7436d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:34.058416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d38953-1927-4c22-b99f-7a42baa7436d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:34.058927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d38953-1927-4c22-b99f-7a42baa7436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:34.077940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-42d38953-1927-4c22-b99f-7a42baa7436d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:34.079498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-42d38953-1927-4c22-b99f-7a42baa7436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:34.212095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 85/169] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:34.214111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0561a-1611-4bd4-9f41-96c1f4671f43 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:34.214406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0561a-1611-4bd4-9f41-96c1f4671f43 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:34.214688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0561a-1611-4bd4-9f41-96c1f4671f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:34.244927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8ab0561a-1611-4bd4-9f41-96c1f4671f43 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:34.246780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ab0561a-1611-4bd4-9f41-96c1f4671f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:34.299159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94769df1-1ec6-40ae-8096-fe713529b8af None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:34.376085 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 86/170] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:34.378501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a5136-2def-49c9-b60b-b0cf957bc477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:34.379808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a5136-2def-49c9-b60b-b0cf957bc477 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:34.380804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0561a-1611-4bd4-9f41-96c1f4671f43 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:34.381771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a5136-2def-49c9-b60b-b0cf957bc477 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:34.382284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a5136-2def-49c9-b60b-b0cf957bc477 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:34.384975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a5136-2def-49c9-b60b-b0cf957bc477 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:34.387327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a5136-2def-49c9-b60b-b0cf957bc477 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:34.396172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 85/171] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:33 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:34.397348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a5136-2def-49c9-b60b-b0cf957bc477 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:34.461822 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:34.464456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:34.553758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0561a-1611-4bd4-9f41-96c1f4671f43 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:34.575471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a5136-2def-49c9-b60b-b0cf957bc477 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:34.610621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0f5d-a6e8-4042-9918-69a662eda649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:34.611622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0f5d-a6e8-4042-9918-69a662eda649 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:34.612014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0f5d-a6e8-4042-9918-69a662eda649 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:34.612400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0f5d-a6e8-4042-9918-69a662eda649 None admin] PATH_INFO: `/v3/users/c5bb8b07d7ca43fca8f1f46e762df820` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:34.614139 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0f5d-a6e8-4042-9918-69a662eda649 None admin] RBAC: Authorizing `identity:get_user(user_id=c5bb8b07d7ca43fca8f1f46e762df820)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:34.617838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0f5d-a6e8-4042-9918-69a662eda649 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:34.617838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 87/172] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:34 2022] GET /identity/v3/users/c5bb8b07d7ca43fca8f1f46e762df820 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:34.620472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0f5d-a6e8-4042-9918-69a662eda649 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:34.630848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be671a-5d5e-4ede-a47b-4f53816045b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:34.632232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be671a-5d5e-4ede-a47b-4f53816045b3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:34.633161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be671a-5d5e-4ede-a47b-4f53816045b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:34.633644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be671a-5d5e-4ede-a47b-4f53816045b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:34.647552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be671a-5d5e-4ede-a47b-4f53816045b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-04be671a-5d5e-4ede-a47b-4f53816045b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:34.659573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:34.660720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:34.661819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:34.665189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 86/173] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 14:59:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:34.666195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be671a-5d5e-4ede-a47b-4f53816045b3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:34.752435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0f5d-a6e8-4042-9918-69a662eda649 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:34.768413 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:34.788950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:34.794127 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec8801-e6a2-403c-877b-8cad6e5b8ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:34.794960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec8801-e6a2-403c-877b-8cad6e5b8ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:34.796176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec8801-e6a2-403c-877b-8cad6e5b8ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:34.797309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec8801-e6a2-403c-877b-8cad6e5b8ed8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:34.798479 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec8801-e6a2-403c-877b-8cad6e5b8ed8 None admin] RBAC: Adding query filter params (role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=b2ac89cfedcc4836b5603444826c7753, user.id=c5bb8b07d7ca43fca8f1f46e762df820) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:34.798906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec8801-e6a2-403c-877b-8cad6e5b8ed8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:34.800894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec8801-e6a2-403c-877b-8cad6e5b8ed8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:34.807674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 88/174] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:34 2022] GET /identity/v3/role_assignments?user.id=c5bb8b07d7ca43fca8f1f46e762df820&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:34.809337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0b24a-6d94-423b-951f-3ae4e12cc4a2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:34.809771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0b24a-6d94-423b-951f-3ae4e12cc4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:34.810143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0b24a-6d94-423b-951f-3ae4e12cc4a2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:34.811707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 89/175] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:34.812112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be671a-5d5e-4ede-a47b-4f53816045b3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:34.821530 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0b24a-6d94-423b-951f-3ae4e12cc4a2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:34.864491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0513a3-2a92-47a8-98c4-8a3b0ef5ec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:34.865322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0513a3-2a92-47a8-98c4-8a3b0ef5ec2a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:34.865643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0513a3-2a92-47a8-98c4-8a3b0ef5ec2a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:34.865919 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0513a3-2a92-47a8-98c4-8a3b0ef5ec2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:34.878656 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0513a3-2a92-47a8-98c4-8a3b0ef5ec2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ed0513a3-2a92-47a8-98c4-8a3b0ef5ec2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:34.887384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:34.888418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:34.889259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 87/176] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 14:59:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:34.890577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0513a3-2a92-47a8-98c4-8a3b0ef5ec2a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:34.975363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0b24a-6d94-423b-951f-3ae4e12cc4a2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:35.013785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0513a3-2a92-47a8-98c4-8a3b0ef5ec2a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:35.018158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3584b0-c3cf-4b96-8366-94b6976f7af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:35.018826 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3584b0-c3cf-4b96-8366-94b6976f7af4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.019112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3584b0-c3cf-4b96-8366-94b6976f7af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.019391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3584b0-c3cf-4b96-8366-94b6976f7af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.053950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f6750-4d8d-4c79-941d-e227cc1f34c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:35.054638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f6750-4d8d-4c79-941d-e227cc1f34c8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.054931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f6750-4d8d-4c79-941d-e227cc1f34c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.055209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f6750-4d8d-4c79-941d-e227cc1f34c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.055981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f6750-4d8d-4c79-941d-e227cc1f34c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:35.056297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f6750-4d8d-4c79-941d-e227cc1f34c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:35.059360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f6750-4d8d-4c79-941d-e227cc1f34c8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:35.071590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 88/177] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 14:59:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:35.072946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69816830-3a81-4a6c-ab31-296a93756699 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.073246 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69816830-3a81-4a6c-ab31-296a93756699 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.073577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69816830-3a81-4a6c-ab31-296a93756699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.079234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:35.087716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:35.094979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-69816830-3a81-4a6c-ab31-296a93756699 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:35.097158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-69816830-3a81-4a6c-ab31-296a93756699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:35.114524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3584b0-c3cf-4b96-8366-94b6976f7af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:35.116196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3584b0-c3cf-4b96-8366-94b6976f7af4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:35.174689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 89/178] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:35.176383 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f195d-d416-4888-a9b6-05c5f6ac3f01 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.176667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f195d-d416-4888-a9b6-05c5f6ac3f01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.176942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f195d-d416-4888-a9b6-05c5f6ac3f01 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.178460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 90/179] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:35.181975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f195d-d416-4888-a9b6-05c5f6ac3f01 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:35.239035 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 90/180] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:35.243828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3584b0-c3cf-4b96-8366-94b6976f7af4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:35.301833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f195d-d416-4888-a9b6-05c5f6ac3f01 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:35.326034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:35.340412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd297d69-a903-4f72-a4a6-f625ab9648b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:35.341141 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd297d69-a903-4f72-a4a6-f625ab9648b8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.341361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd297d69-a903-4f72-a4a6-f625ab9648b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.341684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd297d69-a903-4f72-a4a6-f625ab9648b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.342433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd297d69-a903-4f72-a4a6-f625ab9648b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:35.342737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd297d69-a903-4f72-a4a6-f625ab9648b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:35.344668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd297d69-a903-4f72-a4a6-f625ab9648b8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:35.347982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:35.354765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3584b0-c3cf-4b96-8366-94b6976f7af4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:35.357701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 91/181] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:35.360441 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1594e9-b9a8-4bc2-b4e3-9ad7d8da7073 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.360741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1594e9-b9a8-4bc2-b4e3-9ad7d8da7073 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.361026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1594e9-b9a8-4bc2-b4e3-9ad7d8da7073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.382487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2e1594e9-b9a8-4bc2-b4e3-9ad7d8da7073 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:35.383682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2e1594e9-b9a8-4bc2-b4e3-9ad7d8da7073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:35.395826 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec33a0-57ac-4070-b4e0-6f0f26d3a971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:35.396711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec33a0-57ac-4070-b4e0-6f0f26d3a971 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.396996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec33a0-57ac-4070-b4e0-6f0f26d3a971 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.397274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec33a0-57ac-4070-b4e0-6f0f26d3a971 None admin] PATH_INFO: `/v3/users/c5bb8b07d7ca43fca8f1f46e762df820` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.398534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec33a0-57ac-4070-b4e0-6f0f26d3a971 None admin] RBAC: Authorizing `identity:get_user(user_id=c5bb8b07d7ca43fca8f1f46e762df820)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:35.400019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec33a0-57ac-4070-b4e0-6f0f26d3a971 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:35.401712 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 91/182] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:35 2022] GET /identity/v3/users/c5bb8b07d7ca43fca8f1f46e762df820 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:35.407422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec33a0-57ac-4070-b4e0-6f0f26d3a971 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:35.465673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 92/183] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:35.466541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1594e9-b9a8-4bc2-b4e3-9ad7d8da7073 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:35.532192 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec33a0-57ac-4070-b4e0-6f0f26d3a971 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:35.570123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20dd9-ad34-4575-a782-0ee6cd59bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:35.570844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20dd9-ad34-4575-a782-0ee6cd59bd6d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.571125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20dd9-ad34-4575-a782-0ee6cd59bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.571398 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f20dd9-ad34-4575-a782-0ee6cd59bd6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.573683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1594e9-b9a8-4bc2-b4e3-9ad7d8da7073 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:35.581817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f20dd9-ad34-4575-a782-0ee6cd59bd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d3f20dd9-ad34-4575-a782-0ee6cd59bd6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:35.589901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:35.590829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:35.591632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 92/184] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 14:59:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:35.592309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20dd9-ad34-4575-a782-0ee6cd59bd6d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:35.600924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:35.604140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:35.613328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb28d0-cf5d-4ce9-9643-b130121b9175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:35.614393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb28d0-cf5d-4ce9-9643-b130121b9175 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.614770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb28d0-cf5d-4ce9-9643-b130121b9175 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.615062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb28d0-cf5d-4ce9-9643-b130121b9175 None admin] PATH_INFO: `/v3/projects/b4d9412ed6014b219292f0a6f646d782` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.616346 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb28d0-cf5d-4ce9-9643-b130121b9175 None admin] RBAC: Authorizing `identity:get_project(project_id=b4d9412ed6014b219292f0a6f646d782)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:35.617953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb28d0-cf5d-4ce9-9643-b130121b9175 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:35.619653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 93/185] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:35 2022] GET /identity/v3/projects/b4d9412ed6014b219292f0a6f646d782 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:35.620418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb28d0-cf5d-4ce9-9643-b130121b9175 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:35.706145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f20dd9-ad34-4575-a782-0ee6cd59bd6d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:35.721814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb28d0-cf5d-4ce9-9643-b130121b9175 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:35.741544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bfecd-aa4c-4691-99c6-96d82fcad9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:35.742419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bfecd-aa4c-4691-99c6-96d82fcad9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.742699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bfecd-aa4c-4691-99c6-96d82fcad9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.742978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bfecd-aa4c-4691-99c6-96d82fcad9d0 None admin] PATH_INFO: `/v3/users/934372073e7043e799dbf937d35e0be5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.757276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e87226-8d21-4620-b60e-faeb04d7da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:35.757880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bfecd-aa4c-4691-99c6-96d82fcad9d0 None admin] RBAC: Authorizing `identity:get_user(user_id=934372073e7043e799dbf937d35e0be5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:35.757985 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e87226-8d21-4620-b60e-faeb04d7da19 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.758214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e87226-8d21-4620-b60e-faeb04d7da19 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.758490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e87226-8d21-4620-b60e-faeb04d7da19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.759426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bfecd-aa4c-4691-99c6-96d82fcad9d0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:35.761073 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 93/186] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:35 2022] GET /identity/v3/users/934372073e7043e799dbf937d35e0be5 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:35.762372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee804-51e6-4db3-8ec9-d3a52161ec06 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.762672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee804-51e6-4db3-8ec9-d3a52161ec06 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.762980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee804-51e6-4db3-8ec9-d3a52161ec06 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.764247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 94/187] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:35.764949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee804-51e6-4db3-8ec9-d3a52161ec06 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:35.825162 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:35.831148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:35.832963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e87226-8d21-4620-b60e-faeb04d7da19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:35.834454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e87226-8d21-4620-b60e-faeb04d7da19 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:35.873441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee804-51e6-4db3-8ec9-d3a52161ec06 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:35.908915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0457c2-77a4-43cd-93b0-445c3bb0e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:35.909728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0457c2-77a4-43cd-93b0-445c3bb0e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:35.910010 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0457c2-77a4-43cd-93b0-445c3bb0e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:35.910283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0457c2-77a4-43cd-93b0-445c3bb0e9c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:35.911456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0457c2-77a4-43cd-93b0-445c3bb0e9c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:35.912903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0457c2-77a4-43cd-93b0-445c3bb0e9c8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:35.914568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 95/188] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:35.915320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0457c2-77a4-43cd-93b0-445c3bb0e9c8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:35.943874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 94/189] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:35.944723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e87226-8d21-4620-b60e-faeb04d7da19 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:36.021331 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0457c2-77a4-43cd-93b0-445c3bb0e9c8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:36.044415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:36.053134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e87226-8d21-4620-b60e-faeb04d7da19 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:36.053332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:36.059734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263e3d-5c55-461f-94ff-03c728abd374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:36.060402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263e3d-5c55-461f-94ff-03c728abd374 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:36.060698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263e3d-5c55-461f-94ff-03c728abd374 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:36.060977 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263e3d-5c55-461f-94ff-03c728abd374 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:36.061785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263e3d-5c55-461f-94ff-03c728abd374 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:36.062118 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263e3d-5c55-461f-94ff-03c728abd374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:36.064077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263e3d-5c55-461f-94ff-03c728abd374 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:36.072972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 96/190] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 14:59:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:36.073850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263e3d-5c55-461f-94ff-03c728abd374 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:36.092081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c4f0a-bd7b-4e18-8859-06d8756d1b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:36.092751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c4f0a-bd7b-4e18-8859-06d8756d1b32 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:36.093823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c4f0a-bd7b-4e18-8859-06d8756d1b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:36.093965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c4f0a-bd7b-4e18-8859-06d8756d1b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:36.094996 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c4f0a-bd7b-4e18-8859-06d8756d1b32 None admin] RBAC: Adding query filter params (role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=b4d9412ed6014b219292f0a6f646d782, user.id=c5bb8b07d7ca43fca8f1f46e762df820) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:36.095310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c4f0a-bd7b-4e18-8859-06d8756d1b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:36.096756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c4f0a-bd7b-4e18-8859-06d8756d1b32 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:36.103132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 95/191] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:35 2022] GET /identity/v3/role_assignments?user.id=c5bb8b07d7ca43fca8f1f46e762df820&scope.project.id=b4d9412ed6014b219292f0a6f646d782&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:36.104551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad092d-871f-4bf7-a879-e4d482fb40a6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:36.104840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad092d-871f-4bf7-a879-e4d482fb40a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:36.105119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad092d-871f-4bf7-a879-e4d482fb40a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:36.139003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3aad092d-871f-4bf7-a879-e4d482fb40a6 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:36.140640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3aad092d-871f-4bf7-a879-e4d482fb40a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:36.186199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263e3d-5c55-461f-94ff-03c728abd374 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:36.222634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 96/192] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:36.223804 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad092d-871f-4bf7-a879-e4d482fb40a6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:36.235747 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf332-fb94-4e7b-a64b-f451205ad4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:36.237183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf332-fb94-4e7b-a64b-f451205ad4ce None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:36.237500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf332-fb94-4e7b-a64b-f451205ad4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:36.237788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf332-fb94-4e7b-a64b-f451205ad4ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:36.318236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:36.333146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf332-fb94-4e7b-a64b-f451205ad4ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:36.334955 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf332-fb94-4e7b-a64b-f451205ad4ce None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:36.354392 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:36.365756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad092d-871f-4bf7-a879-e4d482fb40a6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:36.400689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af884d-a9b6-4232-a752-f1d0c44cbe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:36.401700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af884d-a9b6-4232-a752-f1d0c44cbe74 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:36.401700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af884d-a9b6-4232-a752-f1d0c44cbe74 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:36.401966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af884d-a9b6-4232-a752-f1d0c44cbe74 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:36.402689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af884d-a9b6-4232-a752-f1d0c44cbe74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:36.404147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af884d-a9b6-4232-a752-f1d0c44cbe74 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:36.425255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 97/193] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 14:59:36 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:36.426101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af884d-a9b6-4232-a752-f1d0c44cbe74 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:36.461041 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 97/194] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:36.462133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf332-fb94-4e7b-a64b-f451205ad4ce None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:36.548676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af884d-a9b6-4232-a752-f1d0c44cbe74 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:36.580154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:36.595014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf332-fb94-4e7b-a64b-f451205ad4ce None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:36.595197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439ac10-e412-415f-857a-a4ffce6a7a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:36.595688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439ac10-e412-415f-857a-a4ffce6a7a02 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:36.595974 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439ac10-e412-415f-857a-a4ffce6a7a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:36.596248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439ac10-e412-415f-857a-a4ffce6a7a02 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:36.597521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439ac10-e412-415f-857a-a4ffce6a7a02 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:36.599840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439ac10-e412-415f-857a-a4ffce6a7a02 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:36.600900 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 98/195] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:36 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:36.601945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439ac10-e412-415f-857a-a4ffce6a7a02 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:36.625697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:36.642549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3e423-d488-493f-8239-83ad35fcf308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:36.643428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3e423-d488-493f-8239-83ad35fcf308 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:36.643715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3e423-d488-493f-8239-83ad35fcf308 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:36.643986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3e423-d488-493f-8239-83ad35fcf308 None admin] PATH_INFO: `/v3/users/934372073e7043e799dbf937d35e0be5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:36.645220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3e423-d488-493f-8239-83ad35fcf308 None admin] RBAC: Authorizing `identity:get_user(user_id=934372073e7043e799dbf937d35e0be5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:36.646788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3e423-d488-493f-8239-83ad35fcf308 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:36.648452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 98/196] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:36 2022] GET /identity/v3/users/934372073e7043e799dbf937d35e0be5 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:36.649279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3e423-d488-493f-8239-83ad35fcf308 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:36.751047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439ac10-e412-415f-857a-a4ffce6a7a02 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:36.798587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372a036-ddfa-4b2a-8179-47e055e347d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:36.799857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372a036-ddfa-4b2a-8179-47e055e347d1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:36.800107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3e423-d488-493f-8239-83ad35fcf308 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:36.800544 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372a036-ddfa-4b2a-8179-47e055e347d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:36.801035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372a036-ddfa-4b2a-8179-47e055e347d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:36.813933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372a036-ddfa-4b2a-8179-47e055e347d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3372a036-ddfa-4b2a-8179-47e055e347d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:36.822179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:36.823108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:36.823917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:36.826321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 99/197] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:36.827340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372a036-ddfa-4b2a-8179-47e055e347d1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:36.854534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716234da-2b6c-4d01-bf26-ac2de9e86013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:36.855503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716234da-2b6c-4d01-bf26-ac2de9e86013 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:36.855814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716234da-2b6c-4d01-bf26-ac2de9e86013 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:36.856348 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716234da-2b6c-4d01-bf26-ac2de9e86013 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:36.858048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716234da-2b6c-4d01-bf26-ac2de9e86013 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:36.861369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716234da-2b6c-4d01-bf26-ac2de9e86013 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:36.863427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 99/198] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:36 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:36.864392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716234da-2b6c-4d01-bf26-ac2de9e86013 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:36.898497 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:36.941526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:36.979812 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372a036-ddfa-4b2a-8179-47e055e347d1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:36.990971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716234da-2b6c-4d01-bf26-ac2de9e86013 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:37.028738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32fe9c-906c-45a6-9636-4548f70f802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:37.029361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0537e-a11f-4ec9-867c-4703c7cb38e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:37.030052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0537e-a11f-4ec9-867c-4703c7cb38e3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:37.030342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0537e-a11f-4ec9-867c-4703c7cb38e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:37.030786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32fe9c-906c-45a6-9636-4548f70f802e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:37.031071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0537e-a11f-4ec9-867c-4703c7cb38e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:37.031626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32fe9c-906c-45a6-9636-4548f70f802e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:37.032115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32fe9c-906c-45a6-9636-4548f70f802e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:37.032214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0537e-a11f-4ec9-867c-4703c7cb38e3 None admin] RBAC: Adding query filter params (role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=b2ac89cfedcc4836b5603444826c7753, user.id=c5bb8b07d7ca43fca8f1f46e762df820) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:37.032745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0537e-a11f-4ec9-867c-4703c7cb38e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:37.034250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0537e-a11f-4ec9-867c-4703c7cb38e3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:37.042256 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 100/199] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:36 2022] GET /identity/v3/role_assignments?user.id=c5bb8b07d7ca43fca8f1f46e762df820&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:37.043117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0537e-a11f-4ec9-867c-4703c7cb38e3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:37.126997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32fe9c-906c-45a6-9636-4548f70f802e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:37.128998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32fe9c-906c-45a6-9636-4548f70f802e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:37.162692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:37.208239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0537e-a11f-4ec9-867c-4703c7cb38e3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:37.251876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d240-f23b-4ba9-8a13-4170d3ac4395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:37.252917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d240-f23b-4ba9-8a13-4170d3ac4395 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:37.253422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d240-f23b-4ba9-8a13-4170d3ac4395 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:37.253925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d240-f23b-4ba9-8a13-4170d3ac4395 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:37.254891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1d240-f23b-4ba9-8a13-4170d3ac4395 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:37.255503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1d240-f23b-4ba9-8a13-4170d3ac4395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:37.257119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1d240-f23b-4ba9-8a13-4170d3ac4395 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:37.259609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 100/200] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:37.261028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32fe9c-906c-45a6-9636-4548f70f802e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:37.269683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:37.272350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 101/201] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:37.275905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d240-f23b-4ba9-8a13-4170d3ac4395 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:37.425054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32fe9c-906c-45a6-9636-4548f70f802e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:37.435166 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d240-f23b-4ba9-8a13-4170d3ac4395 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:37.462513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:37.473084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8577-f6a1-4e7c-b338-d1ec150d06ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:37.473776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8577-f6a1-4e7c-b338-d1ec150d06ed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:37.474054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8577-f6a1-4e7c-b338-d1ec150d06ed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:37.474375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8577-f6a1-4e7c-b338-d1ec150d06ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:37.475368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8577-f6a1-4e7c-b338-d1ec150d06ed None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=6792456cc69f4d958161cf85839a9443, user.id=934372073e7043e799dbf937d35e0be5) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:37.475561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8577-f6a1-4e7c-b338-d1ec150d06ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:37.476990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8577-f6a1-4e7c-b338-d1ec150d06ed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:37.483521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 101/202] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:37 2022] GET /identity/v3/role_assignments?user.id=934372073e7043e799dbf937d35e0be5&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:37.485236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8577-f6a1-4e7c-b338-d1ec150d06ed None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:37.493210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de122f96-9161-4e72-aa5c-0c732fe26b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:37.494440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de122f96-9161-4e72-aa5c-0c732fe26b61 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:37.494954 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de122f96-9161-4e72-aa5c-0c732fe26b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:37.495436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de122f96-9161-4e72-aa5c-0c732fe26b61 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:37.502716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de122f96-9161-4e72-aa5c-0c732fe26b61 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:37.509577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de122f96-9161-4e72-aa5c-0c732fe26b61 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:37.511610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 102/203] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:37 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:37.518325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de122f96-9161-4e72-aa5c-0c732fe26b61 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:37.618902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:37.691879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de122f96-9161-4e72-aa5c-0c732fe26b61 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:37.725782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8577-f6a1-4e7c-b338-d1ec150d06ed None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:37.757356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe384c7d-1aa2-468c-9db5-3f5569122ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:37.758093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe384c7d-1aa2-468c-9db5-3f5569122ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:37.758634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe384c7d-1aa2-468c-9db5-3f5569122ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:37.758923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe384c7d-1aa2-468c-9db5-3f5569122ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:37.759772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe384c7d-1aa2-468c-9db5-3f5569122ac5 None admin] RBAC: Adding query filter params (role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=6792456cc69f4d958161cf85839a9443, user.id=934372073e7043e799dbf937d35e0be5) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:37.761501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe384c7d-1aa2-468c-9db5-3f5569122ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:37.762080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe384c7d-1aa2-468c-9db5-3f5569122ac5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:37.768938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 103/204] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:37 2022] GET /identity/v3/role_assignments?user.id=934372073e7043e799dbf937d35e0be5&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:37.819470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e99691-0c65-4b21-8809-6bb0c5d72405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:37.820787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e99691-0c65-4b21-8809-6bb0c5d72405 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:37.821290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e99691-0c65-4b21-8809-6bb0c5d72405 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:37.821853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e99691-0c65-4b21-8809-6bb0c5d72405 None admin] PATH_INFO: `/v3/users/a4a4a555e5ab456db8500c3d674c9a9f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:37.823555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e99691-0c65-4b21-8809-6bb0c5d72405 None admin] RBAC: Authorizing `identity:get_user(user_id=a4a4a555e5ab456db8500c3d674c9a9f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:37.825329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e99691-0c65-4b21-8809-6bb0c5d72405 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:37.827649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 102/205] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:37 2022] GET /identity/v3/users/a4a4a555e5ab456db8500c3d674c9a9f => generated 289 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:37.833873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe384c7d-1aa2-468c-9db5-3f5569122ac5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:37.970573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe384c7d-1aa2-468c-9db5-3f5569122ac5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:38.005499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:38.011769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c0b95-3878-403f-ac0b-e72c512a1f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:38.012626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c0b95-3878-403f-ac0b-e72c512a1f9c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:38.013127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c0b95-3878-403f-ac0b-e72c512a1f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:38.013408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c0b95-3878-403f-ac0b-e72c512a1f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:38.087332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c0b95-3878-403f-ac0b-e72c512a1f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:38.088800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c0b95-3878-403f-ac0b-e72c512a1f9c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:38.191384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 104/206] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:38.198532 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e99691-0c65-4b21-8809-6bb0c5d72405 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:38.306177 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:38.365289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e99691-0c65-4b21-8809-6bb0c5d72405 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:38.401303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e68fc-2b3b-430e-bbcf-cf4683989937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:38.402199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e68fc-2b3b-430e-bbcf-cf4683989937 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:38.402487 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e68fc-2b3b-430e-bbcf-cf4683989937 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:38.402766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e68fc-2b3b-430e-bbcf-cf4683989937 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:38.403972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e68fc-2b3b-430e-bbcf-cf4683989937 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:38.406128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e68fc-2b3b-430e-bbcf-cf4683989937 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:38.408649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 103/207] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:38 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:38.414570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c0b95-3878-403f-ac0b-e72c512a1f9c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:38.492001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:38.597037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c0b95-3878-403f-ac0b-e72c512a1f9c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:38.636673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039575d-6d47-4761-9a2d-6e65df64fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:38.637341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039575d-6d47-4761-9a2d-6e65df64fd25 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:38.637655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039575d-6d47-4761-9a2d-6e65df64fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:38.637935 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039575d-6d47-4761-9a2d-6e65df64fd25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:38.638774 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039575d-6d47-4761-9a2d-6e65df64fd25 None admin] RBAC: Adding query filter params (role.id=8ac3052831b845bc88d5e829f84cb382, scope.project.id=b2ac89cfedcc4836b5603444826c7753, user.id=a4a4a555e5ab456db8500c3d674c9a9f) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:38.639094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039575d-6d47-4761-9a2d-6e65df64fd25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:38.641101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039575d-6d47-4761-9a2d-6e65df64fd25 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:38.647675 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 105/208] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:38 2022] GET /identity/v3/role_assignments?user.id=a4a4a555e5ab456db8500c3d674c9a9f&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=8ac3052831b845bc88d5e829f84cb382 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:39.022981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e5ee-c1d1-4dcf-8a09-8b45f5f68fd7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:39.023303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e5ee-c1d1-4dcf-8a09-8b45f5f68fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:39.023545 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e5ee-c1d1-4dcf-8a09-8b45f5f68fd7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:39.025058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 104/209] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:39.031076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c66d1-1711-44ce-a26d-e28afe0e90ba None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:39.031649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c66d1-1711-44ce-a26d-e28afe0e90ba None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:39.031649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c66d1-1711-44ce-a26d-e28afe0e90ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:39.051819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b65c66d1-1711-44ce-a26d-e28afe0e90ba None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:39.053002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b65c66d1-1711-44ce-a26d-e28afe0e90ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:39.142094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 106/210] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:39.170414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e5ee-c1d1-4dcf-8a09-8b45f5f68fd7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:39.226434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0ddcc-5be1-48d9-bf28-2a89175f3b32 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:39.226748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0ddcc-5be1-48d9-bf28-2a89175f3b32 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:39.227111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0ddcc-5be1-48d9-bf28-2a89175f3b32 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:39.228613 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 107/211] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:39.235307 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578e0b5-610d-47b9-a44d-849fcf79b455 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:39.235600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578e0b5-610d-47b9-a44d-849fcf79b455 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:39.235996 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578e0b5-610d-47b9-a44d-849fcf79b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:39.260294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5578e0b5-610d-47b9-a44d-849fcf79b455 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:39.261736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5578e0b5-610d-47b9-a44d-849fcf79b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:39.283053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e5ee-c1d1-4dcf-8a09-8b45f5f68fd7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:39.289335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:39.317391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:39.333252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb68e78-3b0b-4595-9839-c35056927249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:39.334060 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb68e78-3b0b-4595-9839-c35056927249 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:39.334374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb68e78-3b0b-4595-9839-c35056927249 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:39.334604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb68e78-3b0b-4595-9839-c35056927249 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:39.335769 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb68e78-3b0b-4595-9839-c35056927249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:39.337213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb68e78-3b0b-4595-9839-c35056927249 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:39.339144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 105/212] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:39.345374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb68e78-3b0b-4595-9839-c35056927249 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:39.363563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 108/213] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:39.387213 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578e0b5-610d-47b9-a44d-849fcf79b455 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:39.458730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb68e78-3b0b-4595-9839-c35056927249 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:39.491202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578e0b5-610d-47b9-a44d-849fcf79b455 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:39.495273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe595871-7e90-49fc-aa79-5fd3cb699c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:39.495948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe595871-7e90-49fc-aa79-5fd3cb699c86 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:39.496232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe595871-7e90-49fc-aa79-5fd3cb699c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:39.496518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe595871-7e90-49fc-aa79-5fd3cb699c86 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:39.497234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe595871-7e90-49fc-aa79-5fd3cb699c86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:39.498724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe595871-7e90-49fc-aa79-5fd3cb699c86 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:39.525464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 106/214] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 14:59:39 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 14:59:39.535919 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e7124-98cc-40e1-80b8-e87d18635061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:39.537007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7124-98cc-40e1-80b8-e87d18635061 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:39.537361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7124-98cc-40e1-80b8-e87d18635061 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:39.537886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7124-98cc-40e1-80b8-e87d18635061 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:39.552230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e7124-98cc-40e1-80b8-e87d18635061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-463e7124-98cc-40e1-80b8-e87d18635061 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:39.560657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:39.561771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:39.563018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 109/215] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:39.570033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe595871-7e90-49fc-aa79-5fd3cb699c86 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:39.640956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:39.699485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe595871-7e90-49fc-aa79-5fd3cb699c86 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:39.742850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348d77-5e17-4482-ac91-2e0fd2f05edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:39.743546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348d77-5e17-4482-ac91-2e0fd2f05edf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:39.743928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348d77-5e17-4482-ac91-2e0fd2f05edf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:39.744227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348d77-5e17-4482-ac91-2e0fd2f05edf None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:39.745026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41348d77-5e17-4482-ac91-2e0fd2f05edf None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:39.745427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41348d77-5e17-4482-ac91-2e0fd2f05edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:39.746924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41348d77-5e17-4482-ac91-2e0fd2f05edf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:39.757403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 107/216] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:39.762950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e7124-98cc-40e1-80b8-e87d18635061 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:39.782776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:39.885438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e7124-98cc-40e1-80b8-e87d18635061 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:39.925370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7ae9d-892e-4607-9a0b-307657b7c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:39.926658 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7ae9d-892e-4607-9a0b-307657b7c024 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:39.926971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7ae9d-892e-4607-9a0b-307657b7c024 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:39.927214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7ae9d-892e-4607-9a0b-307657b7c024 None admin] PATH_INFO: `/v3/users/932b7ab6cf164dda9154103b60406420` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:39.946518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7ae9d-892e-4607-9a0b-307657b7c024 None admin] RBAC: Authorizing `identity:get_user(user_id=932b7ab6cf164dda9154103b60406420)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:39.948006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7ae9d-892e-4607-9a0b-307657b7c024 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:39.949787 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 110/217] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:39 2022] GET /identity/v3/users/932b7ab6cf164dda9154103b60406420 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:39.955917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348d77-5e17-4482-ac91-2e0fd2f05edf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:40.019457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9a7c2-0d12-4011-bbf6-845426903302 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.019651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9a7c2-0d12-4011-bbf6-845426903302 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.019924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9a7c2-0d12-4011-bbf6-845426903302 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.022407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 111/218] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:40.035395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe3f3-feef-4853-bf54-6a32c915dca1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.036025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe3f3-feef-4853-bf54-6a32c915dca1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.036025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe3f3-feef-4853-bf54-6a32c915dca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.060681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cf9fe3f3-feef-4853-bf54-6a32c915dca1 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:40.062618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cf9fe3f3-feef-4853-bf54-6a32c915dca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:40.077568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348d77-5e17-4482-ac91-2e0fd2f05edf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:40.092120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:40.114751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e67e6-17de-4f22-9d72-91f219e73f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:40.115402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e67e6-17de-4f22-9d72-91f219e73f35 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.115686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e67e6-17de-4f22-9d72-91f219e73f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.115966 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e67e6-17de-4f22-9d72-91f219e73f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.153757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 112/219] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:40.166761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68957335-afcf-4855-b7fa-cfc4e515ecf5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.167095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68957335-afcf-4855-b7fa-cfc4e515ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.167377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68957335-afcf-4855-b7fa-cfc4e515ecf5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.169073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 113/220] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:40 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:40.175637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ab4d3-b645-4847-8616-b547c910cbe1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.175975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ab4d3-b645-4847-8616-b547c910cbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.176265 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ab4d3-b645-4847-8616-b547c910cbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.189875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:40.192862 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e67e6-17de-4f22-9d72-91f219e73f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:40.194461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e67e6-17de-4f22-9d72-91f219e73f35 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:40.205385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-937ab4d3-b645-4847-8616-b547c910cbe1 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:40.206735 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-937ab4d3-b645-4847-8616-b547c910cbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:40.306152 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 114/221] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:40.306929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ab4d3-b645-4847-8616-b547c910cbe1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:40.332674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 108/222] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:40.338355 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e67e6-17de-4f22-9d72-91f219e73f35 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:40.355354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:40.435677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ab4d3-b645-4847-8616-b547c910cbe1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:40.474696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fbde4-4bd3-4f04-8e22-76e36fefdc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:40.475660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fbde4-4bd3-4f04-8e22-76e36fefdc88 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.476039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fbde4-4bd3-4f04-8e22-76e36fefdc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.476416 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fbde4-4bd3-4f04-8e22-76e36fefdc88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.478699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:40.484539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e67e6-17de-4f22-9d72-91f219e73f35 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:40.489388 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fbde4-4bd3-4f04-8e22-76e36fefdc88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4b4fbde4-4bd3-4f04-8e22-76e36fefdc88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:40.497227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:40.498537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:40.500078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:40.501766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 115/223] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 14:59:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:40.507496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fbde4-4bd3-4f04-8e22-76e36fefdc88 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:40.533779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae2b5e-dab4-4a7d-9170-a8635cb30995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:40.534932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae2b5e-dab4-4a7d-9170-a8635cb30995 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.535607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae2b5e-dab4-4a7d-9170-a8635cb30995 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.536078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae2b5e-dab4-4a7d-9170-a8635cb30995 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.537860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae2b5e-dab4-4a7d-9170-a8635cb30995 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:40.539544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae2b5e-dab4-4a7d-9170-a8635cb30995 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:40.542261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 109/224] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:40 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:40.543239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae2b5e-dab4-4a7d-9170-a8635cb30995 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:40.650848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fbde4-4bd3-4f04-8e22-76e36fefdc88 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:40.661935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:40.687834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae2b5e-dab4-4a7d-9170-a8635cb30995 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:40.695738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b962f-39c4-4762-9f8d-c467e93c9535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:40.696806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b962f-39c4-4762-9f8d-c467e93c9535 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.697872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b962f-39c4-4762-9f8d-c467e93c9535 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.698329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b962f-39c4-4762-9f8d-c467e93c9535 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.714726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b962f-39c4-4762-9f8d-c467e93c9535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ef7b962f-39c4-4762-9f8d-c467e93c9535 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:40.726777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:40.727733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:40.728537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:40.730776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 116/225] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 14:59:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:40.731322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a209cc-efe1-4a59-afc0-e9d9da346d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:40.731867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b962f-39c4-4762-9f8d-c467e93c9535 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:40.732265 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a209cc-efe1-4a59-afc0-e9d9da346d9e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.732908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a209cc-efe1-4a59-afc0-e9d9da346d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.733416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a209cc-efe1-4a59-afc0-e9d9da346d9e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.734589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a209cc-efe1-4a59-afc0-e9d9da346d9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:40.734995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a209cc-efe1-4a59-afc0-e9d9da346d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:40.736794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a209cc-efe1-4a59-afc0-e9d9da346d9e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:40.746085 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 110/226] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:40.751494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a209cc-efe1-4a59-afc0-e9d9da346d9e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:40.805348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:40.864186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b962f-39c4-4762-9f8d-c467e93c9535 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:40.864391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a209cc-efe1-4a59-afc0-e9d9da346d9e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:40.903087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99288f2-c5d9-48a3-8221-ddd200ed3b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:40.903823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99288f2-c5d9-48a3-8221-ddd200ed3b35 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.904252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99288f2-c5d9-48a3-8221-ddd200ed3b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.904722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99288f2-c5d9-48a3-8221-ddd200ed3b35 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.906049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99288f2-c5d9-48a3-8221-ddd200ed3b35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:40.906505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99288f2-c5d9-48a3-8221-ddd200ed3b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:40.906924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c7740-655b-4564-96aa-0232368bec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:40.907771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c7740-655b-4564-96aa-0232368bec19 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:40.908192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c7740-655b-4564-96aa-0232368bec19 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:40.908349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99288f2-c5d9-48a3-8221-ddd200ed3b35 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:40.908753 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c7740-655b-4564-96aa-0232368bec19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:40.909781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c7740-655b-4564-96aa-0232368bec19 None admin] RBAC: Adding query filter params (role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=6792456cc69f4d958161cf85839a9443, user.id=932b7ab6cf164dda9154103b60406420) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:40.910491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c7740-655b-4564-96aa-0232368bec19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:40.912535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c7740-655b-4564-96aa-0232368bec19 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:40.918482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 111/227] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 14:59:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:40.919512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99288f2-c5d9-48a3-8221-ddd200ed3b35 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:40.919770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 117/228] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:40 2022] GET /identity/v3/role_assignments?user.id=932b7ab6cf164dda9154103b60406420&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:40.924658 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c7740-655b-4564-96aa-0232368bec19 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:40.941292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:41.051962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c7740-655b-4564-96aa-0232368bec19 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:41.074073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:41.099171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e9fde-cdd6-4c3f-9177-c7c24b486b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:41.101051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e9fde-cdd6-4c3f-9177-c7c24b486b8e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:41.101721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e9fde-cdd6-4c3f-9177-c7c24b486b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:41.102224 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e9fde-cdd6-4c3f-9177-c7c24b486b8e None admin] PATH_INFO: `/v3/users/934372073e7043e799dbf937d35e0be5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:41.104463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e9fde-cdd6-4c3f-9177-c7c24b486b8e None admin] RBAC: Authorizing `identity:get_user(user_id=934372073e7043e799dbf937d35e0be5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:41.106370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e9fde-cdd6-4c3f-9177-c7c24b486b8e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:41.108889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 118/229] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:40 2022] GET /identity/v3/users/934372073e7043e799dbf937d35e0be5 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:41.114726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e9fde-cdd6-4c3f-9177-c7c24b486b8e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:41.160262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99288f2-c5d9-48a3-8221-ddd200ed3b35 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:41.208189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a2ee6-d8cd-4ea7-bab3-07060f7f0f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:41.209699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a2ee6-d8cd-4ea7-bab3-07060f7f0f8c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:41.210649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a2ee6-d8cd-4ea7-bab3-07060f7f0f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:41.211128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a2ee6-d8cd-4ea7-bab3-07060f7f0f8c None admin] PATH_INFO: `/v3/users/934372073e7043e799dbf937d35e0be5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:41.213093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a2ee6-d8cd-4ea7-bab3-07060f7f0f8c None admin] RBAC: Authorizing `identity:get_user(user_id=934372073e7043e799dbf937d35e0be5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:41.215143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a2ee6-d8cd-4ea7-bab3-07060f7f0f8c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:41.216968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 112/230] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:40 2022] GET /identity/v3/users/934372073e7043e799dbf937d35e0be5 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:41.223055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a2ee6-d8cd-4ea7-bab3-07060f7f0f8c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:41.233385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e9fde-cdd6-4c3f-9177-c7c24b486b8e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:41.308121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01136f99-6a20-4f2f-8ca3-3f06162015cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:41.308952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01136f99-6a20-4f2f-8ca3-3f06162015cd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:41.309240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01136f99-6a20-4f2f-8ca3-3f06162015cd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:41.309547 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01136f99-6a20-4f2f-8ca3-3f06162015cd None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:41.314240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01136f99-6a20-4f2f-8ca3-3f06162015cd None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:41.315199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:41.316985 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01136f99-6a20-4f2f-8ca3-3f06162015cd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:41.323081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 119/231] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:41 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:41.329253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01136f99-6a20-4f2f-8ca3-3f06162015cd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:41.353496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a2ee6-d8cd-4ea7-bab3-07060f7f0f8c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:41.387950 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58668426-6283-40e0-951e-47f1e9f4e5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:41.388822 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58668426-6283-40e0-951e-47f1e9f4e5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:41.389732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58668426-6283-40e0-951e-47f1e9f4e5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:41.390620 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58668426-6283-40e0-951e-47f1e9f4e5b4 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:41.391732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58668426-6283-40e0-951e-47f1e9f4e5b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:41.393354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58668426-6283-40e0-951e-47f1e9f4e5b4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:41.395302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 113/232] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:41 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:41.401746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58668426-6283-40e0-951e-47f1e9f4e5b4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:41.474761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:41.522020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58668426-6283-40e0-951e-47f1e9f4e5b4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:41.564259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f60621-74ab-4ca5-a6d8-fe4cbf466eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:41.565393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f60621-74ab-4ca5-a6d8-fe4cbf466eb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:41.565696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f60621-74ab-4ca5-a6d8-fe4cbf466eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:41.565971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f60621-74ab-4ca5-a6d8-fe4cbf466eb7 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443/users/934372073e7043e799dbf937d35e0be5/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:41.567560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01136f99-6a20-4f2f-8ca3-3f06162015cd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:41.567999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f60621-74ab-4ca5-a6d8-fe4cbf466eb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6792456cc69f4d958161cf85839a9443, user_id=934372073e7043e799dbf937d35e0be5, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:41.569443 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f60621-74ab-4ca5-a6d8-fe4cbf466eb7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:41.590281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 114/233] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 14:59:41 2022] PUT /identity/v3/projects/6792456cc69f4d958161cf85839a9443/users/934372073e7043e799dbf937d35e0be5/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:41.626885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f290b-4b54-4e60-8fd4-df7bdf1131e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:41.628291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f290b-4b54-4e60-8fd4-df7bdf1131e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:41.628813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f290b-4b54-4e60-8fd4-df7bdf1131e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:41.629297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f290b-4b54-4e60-8fd4-df7bdf1131e1 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443/users/934372073e7043e799dbf937d35e0be5/roles/b1558d27591d4ee3b4070a19333d6180` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:41.631887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f290b-4b54-4e60-8fd4-df7bdf1131e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6792456cc69f4d958161cf85839a9443, user_id=934372073e7043e799dbf937d35e0be5, role_id=b1558d27591d4ee3b4070a19333d6180)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:41.633779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f290b-4b54-4e60-8fd4-df7bdf1131e1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:41.657688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 120/234] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 14:59:41 2022] PUT /identity/v3/projects/6792456cc69f4d958161cf85839a9443/users/934372073e7043e799dbf937d35e0be5/roles/b1558d27591d4ee3b4070a19333d6180 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:42.131259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118308ea-d0bb-4644-96fc-1cbccbb0012d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:42.131635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118308ea-d0bb-4644-96fc-1cbccbb0012d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:42.131835 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118308ea-d0bb-4644-96fc-1cbccbb0012d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:42.133375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 115/235] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:42.138886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34566-01de-406d-a40c-5d3a44f2c578 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:42.139977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34566-01de-406d-a40c-5d3a44f2c578 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:42.140542 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34566-01de-406d-a40c-5d3a44f2c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:42.158702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-16d34566-01de-406d-a40c-5d3a44f2c578 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:42.160231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-16d34566-01de-406d-a40c-5d3a44f2c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:42.250404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 121/236] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:42.289343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118308ea-d0bb-4644-96fc-1cbccbb0012d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:42.292793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:42.301422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbccaa-a547-42dc-9b9a-98989ba46ac4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:42.301779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbccaa-a547-42dc-9b9a-98989ba46ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:42.302100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbccaa-a547-42dc-9b9a-98989ba46ac4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:42.303680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 122/237] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:42.311963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2ba2d-620b-44cd-a022-6ae2383d9ad3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:42.312465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2ba2d-620b-44cd-a022-6ae2383d9ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:42.312835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2ba2d-620b-44cd-a022-6ae2383d9ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:42.339895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f0d2ba2d-620b-44cd-a022-6ae2383d9ad3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:42.344738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0d2ba2d-620b-44cd-a022-6ae2383d9ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:42.405108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:42.453492 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 123/238] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:42.481601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2ba2d-620b-44cd-a022-6ae2383d9ad3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:42.546621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118308ea-d0bb-4644-96fc-1cbccbb0012d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:42.616540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01852ea-24e7-4806-90a7-9e9dd1c28b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:42.617438 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01852ea-24e7-4806-90a7-9e9dd1c28b56 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:42.617855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01852ea-24e7-4806-90a7-9e9dd1c28b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:42.618148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01852ea-24e7-4806-90a7-9e9dd1c28b56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:42.620366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01852ea-24e7-4806-90a7-9e9dd1c28b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:42.621850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01852ea-24e7-4806-90a7-9e9dd1c28b56 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:42.623661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 116/239] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:42.634313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01852ea-24e7-4806-90a7-9e9dd1c28b56 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:42.684788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2ba2d-620b-44cd-a022-6ae2383d9ad3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:42.756967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356f0e-37d8-44a5-9888-95bfcb5bf0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:42.760095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356f0e-37d8-44a5-9888-95bfcb5bf0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:42.760386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356f0e-37d8-44a5-9888-95bfcb5bf0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:42.760669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356f0e-37d8-44a5-9888-95bfcb5bf0d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:42.779119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:42.792506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356f0e-37d8-44a5-9888-95bfcb5bf0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-46356f0e-37d8-44a5-9888-95bfcb5bf0d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:42.802145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:42.803713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:42.805088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 124/240] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:42.810132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356f0e-37d8-44a5-9888-95bfcb5bf0d3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:42.860204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01852ea-24e7-4806-90a7-9e9dd1c28b56 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:42.873853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:42.954396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517464ca-4de4-4ebb-a852-4c043f90b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:42.956029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517464ca-4de4-4ebb-a852-4c043f90b5d2 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:42.956765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517464ca-4de4-4ebb-a852-4c043f90b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:42.957558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517464ca-4de4-4ebb-a852-4c043f90b5d2 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:42.959156 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517464ca-4de4-4ebb-a852-4c043f90b5d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:42.962650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517464ca-4de4-4ebb-a852-4c043f90b5d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:43.011023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 117/241] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 14:59:42 2022] POST /identity/v3/users => generated 293 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 14:59:43.068414 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356f0e-37d8-44a5-9888-95bfcb5bf0d3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:43.128907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d75db-fb82-4f18-a6d3-16ba4abd7f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:43.130055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d75db-fb82-4f18-a6d3-16ba4abd7f39 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:43.130534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d75db-fb82-4f18-a6d3-16ba4abd7f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:43.131005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d75db-fb82-4f18-a6d3-16ba4abd7f39 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:43.132308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d75db-fb82-4f18-a6d3-16ba4abd7f39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:43.132845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d75db-fb82-4f18-a6d3-16ba4abd7f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:43.135342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d75db-fb82-4f18-a6d3-16ba4abd7f39 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:43.156011 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 125/242] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:43.164327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517464ca-4de4-4ebb-a852-4c043f90b5d2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:43.341417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517464ca-4de4-4ebb-a852-4c043f90b5d2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:43.384193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:43.394859 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abb261-8efd-4a4e-ab1a-31504123baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:43.395744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abb261-8efd-4a4e-ab1a-31504123baf0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:43.396028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abb261-8efd-4a4e-ab1a-31504123baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:43.396308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abb261-8efd-4a4e-ab1a-31504123baf0 None admin] PATH_INFO: `/v3/users/010aeeaaddee42869c3cadaabb9946af` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:43.415054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abb261-8efd-4a4e-ab1a-31504123baf0 None admin] RBAC: Authorizing `identity:get_user(user_id=010aeeaaddee42869c3cadaabb9946af)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:43.416656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abb261-8efd-4a4e-ab1a-31504123baf0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:43.418799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 118/243] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:43 2022] GET /identity/v3/users/010aeeaaddee42869c3cadaabb9946af => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:43.429794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d75db-fb82-4f18-a6d3-16ba4abd7f39 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:43.612046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:43.622962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d75db-fb82-4f18-a6d3-16ba4abd7f39 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:43.668945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa2ac-b7ad-4120-b036-4544194e7cb8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:43.668945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa2ac-b7ad-4120-b036-4544194e7cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:43.668945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa2ac-b7ad-4120-b036-4544194e7cb8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:43.671851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 119/244] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:43.673001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9503d-0fa9-4eee-89df-b0c2f0d9a3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:43.673931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9503d-0fa9-4eee-89df-b0c2f0d9a3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:43.674457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9503d-0fa9-4eee-89df-b0c2f0d9a3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:43.674961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9503d-0fa9-4eee-89df-b0c2f0d9a3a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:43.676297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0e29-0169-45c7-9af0-77d0bc120282 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:43.676590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0e29-0169-45c7-9af0-77d0bc120282 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:43.676868 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0e29-0169-45c7-9af0-77d0bc120282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:43.712603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-81bc0e29-0169-45c7-9af0-77d0bc120282 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:43.714320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81bc0e29-0169-45c7-9af0-77d0bc120282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:43.788712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9503d-0fa9-4eee-89df-b0c2f0d9a3a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:43.790263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9503d-0fa9-4eee-89df-b0c2f0d9a3a4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:43.871060 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 120/245] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 21 14:59:43.923890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc0e29-0169-45c7-9af0-77d0bc120282 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:43.925082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:43.933537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 126/246] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:43.941705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9503d-0fa9-4eee-89df-b0c2f0d9a3a4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:44.089454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9503d-0fa9-4eee-89df-b0c2f0d9a3a4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:44.157657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79af1bb-d237-43e7-9e23-f7655a2c8eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:44.158611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79af1bb-d237-43e7-9e23-f7655a2c8eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:44.158744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79af1bb-d237-43e7-9e23-f7655a2c8eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:44.159082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79af1bb-d237-43e7-9e23-f7655a2c8eb5 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:44.162666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79af1bb-d237-43e7-9e23-f7655a2c8eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:44.164578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79af1bb-d237-43e7-9e23-f7655a2c8eb5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:44.172767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 127/247] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:43 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:44.174189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79af1bb-d237-43e7-9e23-f7655a2c8eb5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:44.223947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc0e29-0169-45c7-9af0-77d0bc120282 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:44.285667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:44.347475 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d75e70-3bda-4933-bd16-ac8b47bda0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:44.348295 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75e70-3bda-4933-bd16-ac8b47bda0dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:44.348575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75e70-3bda-4933-bd16-ac8b47bda0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:44.348852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75e70-3bda-4933-bd16-ac8b47bda0dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:44.382871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d75e70-3bda-4933-bd16-ac8b47bda0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:44.392336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f1d75e70-3bda-4933-bd16-ac8b47bda0dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:44.399273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:44.400223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:44.401055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 121/248] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:44.408867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9c27d-f213-4b4a-9604-1b1c1f7ba8ec None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:44.409121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9c27d-f213-4b4a-9604-1b1c1f7ba8ec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:44.409353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9c27d-f213-4b4a-9604-1b1c1f7ba8ec None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:44.410932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 122/249] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:44.419658 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9c27d-f213-4b4a-9604-1b1c1f7ba8ec None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:44.463795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79af1bb-d237-43e7-9e23-f7655a2c8eb5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:44.516444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67388-0c4a-48c6-b726-904cfc3098b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:44.516444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67388-0c4a-48c6-b726-904cfc3098b1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:44.517688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67388-0c4a-48c6-b726-904cfc3098b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:44.517688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67388-0c4a-48c6-b726-904cfc3098b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:44.518593 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67388-0c4a-48c6-b726-904cfc3098b1 None admin] RBAC: Adding query filter params (role.id=8ac3052831b845bc88d5e829f84cb382, scope.project.id=6792456cc69f4d958161cf85839a9443, user.id=010aeeaaddee42869c3cadaabb9946af) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:44.519119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67388-0c4a-48c6-b726-904cfc3098b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:44.520911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67388-0c4a-48c6-b726-904cfc3098b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:44.539413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 128/250] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:44 2022] GET /identity/v3/role_assignments?user.id=010aeeaaddee42869c3cadaabb9946af&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=8ac3052831b845bc88d5e829f84cb382 => generated 259 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:44.541099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85d0d6-56dd-416c-8d8a-928686896d8f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:44.541645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85d0d6-56dd-416c-8d8a-928686896d8f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:44.542169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85d0d6-56dd-416c-8d8a-928686896d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:44.574095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1d85d0d6-56dd-416c-8d8a-928686896d8f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:44.575685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1d85d0d6-56dd-416c-8d8a-928686896d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:44.586496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9c27d-f213-4b4a-9604-1b1c1f7ba8ec None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:44.667922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c9c82-fc7a-4093-a852-825c55c4d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:44.668531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c9c82-fc7a-4093-a852-825c55c4d5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:44.668816 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c9c82-fc7a-4093-a852-825c55c4d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:44.673872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c9c82-fc7a-4093-a852-825c55c4d5c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:44.674844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c9c82-fc7a-4093-a852-825c55c4d5c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:44.675172 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c9c82-fc7a-4093-a852-825c55c4d5c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:44.676656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c9c82-fc7a-4093-a852-825c55c4d5c0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:44.692569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 123/251] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:44.698518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c9c82-fc7a-4093-a852-825c55c4d5c0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:44.708093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 129/252] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:44.743690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85d0d6-56dd-416c-8d8a-928686896d8f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:44.771343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:44.830748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:44.903276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85d0d6-56dd-416c-8d8a-928686896d8f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:44.931079 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c9c82-fc7a-4093-a852-825c55c4d5c0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:44.987272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d098-163a-4238-b8d0-30a2e6848921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:44.988097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d098-163a-4238-b8d0-30a2e6848921 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:44.988380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d098-163a-4238-b8d0-30a2e6848921 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:44.988682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d098-163a-4238-b8d0-30a2e6848921 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:45.015047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6d098-163a-4238-b8d0-30a2e6848921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-68e6d098-163a-4238-b8d0-30a2e6848921 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:45.023241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:45.024201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:45.025068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:45.025807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 130/253] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 14:59:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:45.032047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35be91-6742-49ee-8e9d-5654de88b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:45.032928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35be91-6742-49ee-8e9d-5654de88b437 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:45.033208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35be91-6742-49ee-8e9d-5654de88b437 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:45.033500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35be91-6742-49ee-8e9d-5654de88b437 None admin] PATH_INFO: `/v3/users/932b7ab6cf164dda9154103b60406420` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:45.034737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35be91-6742-49ee-8e9d-5654de88b437 None admin] RBAC: Authorizing `identity:get_user(user_id=932b7ab6cf164dda9154103b60406420)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:45.036204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35be91-6742-49ee-8e9d-5654de88b437 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:45.041586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 124/254] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:44 2022] GET /identity/v3/users/932b7ab6cf164dda9154103b60406420 => generated 297 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:45.042509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d098-163a-4238-b8d0-30a2e6848921 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:45.043698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35be91-6742-49ee-8e9d-5654de88b437 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:45.241141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35be91-6742-49ee-8e9d-5654de88b437 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:45.251316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:45.302520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d098-163a-4238-b8d0-30a2e6848921 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:45.323591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5a6e6-611c-41ab-a2be-71baab68adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:45.324463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a6e6-611c-41ab-a2be-71baab68adb7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:45.324750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a6e6-611c-41ab-a2be-71baab68adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:45.325030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5a6e6-611c-41ab-a2be-71baab68adb7 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:45.326452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5a6e6-611c-41ab-a2be-71baab68adb7 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:45.329618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5a6e6-611c-41ab-a2be-71baab68adb7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:45.338476 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 125/255] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:45 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:45.339912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66adae-5f90-4c09-8cb5-da7126153613 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:45.340198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66adae-5f90-4c09-8cb5-da7126153613 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:45.340475 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66adae-5f90-4c09-8cb5-da7126153613 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:45.343152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 126/256] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:45.346361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:45.349775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66adae-5f90-4c09-8cb5-da7126153613 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:45.375669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a3f37-1189-4f94-84a3-67d862fce403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:45.376882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a3f37-1189-4f94-84a3-67d862fce403 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:45.377319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a3f37-1189-4f94-84a3-67d862fce403 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:45.377798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a3f37-1189-4f94-84a3-67d862fce403 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:45.378725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a3f37-1189-4f94-84a3-67d862fce403 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:45.379194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a3f37-1189-4f94-84a3-67d862fce403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:45.380739 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a3f37-1189-4f94-84a3-67d862fce403 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:45.391233 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 131/257] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 14:59:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:45.392920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d1ee2-dad6-4557-a626-f29d813246e7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:45.393363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d1ee2-dad6-4557-a626-f29d813246e7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:45.393848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d1ee2-dad6-4557-a626-f29d813246e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:45.413258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c92d1ee2-dad6-4557-a626-f29d813246e7 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:45.415433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c92d1ee2-dad6-4557-a626-f29d813246e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:45.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 132/258] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:45.533599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d1ee2-dad6-4557-a626-f29d813246e7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:45.592625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66adae-5f90-4c09-8cb5-da7126153613 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:45.662839 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a2a3-5f1b-4211-9d3c-42f7df13ac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:45.664021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a2a3-5f1b-4211-9d3c-42f7df13ac3f None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:45.664451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a2a3-5f1b-4211-9d3c-42f7df13ac3f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:45.664875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a2a3-5f1b-4211-9d3c-42f7df13ac3f None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443/users/932b7ab6cf164dda9154103b60406420/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:45.667721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8a2a3-5f1b-4211-9d3c-42f7df13ac3f None admin] RBAC: Authorizing `identity:create_grant(project_id=6792456cc69f4d958161cf85839a9443, user_id=932b7ab6cf164dda9154103b60406420, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:45.670219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8a2a3-5f1b-4211-9d3c-42f7df13ac3f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:45.698222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 127/259] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 14:59:45 2022] PUT /identity/v3/projects/6792456cc69f4d958161cf85839a9443/users/932b7ab6cf164dda9154103b60406420/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:45.699784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a2a3-5f1b-4211-9d3c-42f7df13ac3f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:45.712989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d1ee2-dad6-4557-a626-f29d813246e7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:45.726844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:45.766248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ef771-1ce0-4327-9394-a7e8fe64b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:45.767957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ef771-1ce0-4327-9394-a7e8fe64b897 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:45.768294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ef771-1ce0-4327-9394-a7e8fe64b897 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:45.768579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ef771-1ce0-4327-9394-a7e8fe64b897 None admin] PATH_INFO: `/v3/users/934372073e7043e799dbf937d35e0be5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:45.769899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ef771-1ce0-4327-9394-a7e8fe64b897 None admin] RBAC: Authorizing `identity:get_user(user_id=934372073e7043e799dbf937d35e0be5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:45.771475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ef771-1ce0-4327-9394-a7e8fe64b897 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:45.777847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 133/260] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:45 2022] GET /identity/v3/users/934372073e7043e799dbf937d35e0be5 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:45.778819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ef771-1ce0-4327-9394-a7e8fe64b897 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:45.802622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:45.914344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ef771-1ce0-4327-9394-a7e8fe64b897 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:45.961181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c63cf-e681-4610-93a2-c9e735cf8938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:45.961874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c63cf-e681-4610-93a2-c9e735cf8938 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:45.962153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c63cf-e681-4610-93a2-c9e735cf8938 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:45.965380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c63cf-e681-4610-93a2-c9e735cf8938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.002260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a2a3-5f1b-4211-9d3c-42f7df13ac3f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:46.071935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b989-da69-488f-a341-b2f27340d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:46.072653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b989-da69-488f-a341-b2f27340d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.072930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b989-da69-488f-a341-b2f27340d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.073195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b989-da69-488f-a341-b2f27340d7a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.080227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:46.101684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b989-da69-488f-a341-b2f27340d7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8982b989-da69-488f-a341-b2f27340d7a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:46.110302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:46.111268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 14:59:46.112102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:46.130195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 128/261] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 14:59:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:46.135217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c63cf-e681-4610-93a2-c9e735cf8938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:46.136737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c63cf-e681-4610-93a2-c9e735cf8938 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:46.143447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b989-da69-488f-a341-b2f27340d7a7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:46.266484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:46.278455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b989-da69-488f-a341-b2f27340d7a7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:46.317255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3084-74fd-4c73-96b5-33e4495233f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:46.318226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3084-74fd-4c73-96b5-33e4495233f9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.318652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3084-74fd-4c73-96b5-33e4495233f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.319074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3084-74fd-4c73-96b5-33e4495233f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.319958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3084-74fd-4c73-96b5-33e4495233f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:46.320433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3084-74fd-4c73-96b5-33e4495233f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:46.322048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3084-74fd-4c73-96b5-33e4495233f9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:46.336327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 134/263] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:46.336851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 129/263] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:46.337952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3084-74fd-4c73-96b5-33e4495233f9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:46.341627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c63cf-e681-4610-93a2-c9e735cf8938 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:46.449892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3084-74fd-4c73-96b5-33e4495233f9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:46.489618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314004d-304d-49be-ac1d-5e448af50456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:46.490941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314004d-304d-49be-ac1d-5e448af50456 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.491369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314004d-304d-49be-ac1d-5e448af50456 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.491812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314004d-304d-49be-ac1d-5e448af50456 None admin] PATH_INFO: `/v3/users/934372073e7043e799dbf937d35e0be5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.493178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314004d-304d-49be-ac1d-5e448af50456 None admin] RBAC: Authorizing `identity:get_user(user_id=934372073e7043e799dbf937d35e0be5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:46.494840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314004d-304d-49be-ac1d-5e448af50456 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:46.501575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 130/264] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:46 2022] GET /identity/v3/users/934372073e7043e799dbf937d35e0be5 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:46.503630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314004d-304d-49be-ac1d-5e448af50456 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:46.531600 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:46.541121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:46.592966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c63cf-e681-4610-93a2-c9e735cf8938 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:46.630951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adb4f3-68a6-42f9-91f0-b10079ef1023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:46.632196 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adb4f3-68a6-42f9-91f0-b10079ef1023 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.632680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adb4f3-68a6-42f9-91f0-b10079ef1023 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.633169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adb4f3-68a6-42f9-91f0-b10079ef1023 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.634581 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adb4f3-68a6-42f9-91f0-b10079ef1023 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:46.636249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adb4f3-68a6-42f9-91f0-b10079ef1023 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:46.638068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314004d-304d-49be-ac1d-5e448af50456 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:46.638409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 135/265] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:46 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:46.640776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1473d4-818c-4b30-b670-1a86f656dab0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.641492 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1473d4-818c-4b30-b670-1a86f656dab0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.641993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1473d4-818c-4b30-b670-1a86f656dab0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.647839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 136/266] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:46.649321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f4c5d-1fbe-4e3c-ab7b-22a0bc2dbeed None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.649852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f4c5d-1fbe-4e3c-ab7b-22a0bc2dbeed None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.650328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f4c5d-1fbe-4e3c-ab7b-22a0bc2dbeed None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.651784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 137/267] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:46.652680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f4c5d-1fbe-4e3c-ab7b-22a0bc2dbeed None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:46.684428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7ec44-1765-4ce0-bde0-bd213f776341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:46.685260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7ec44-1765-4ce0-bde0-bd213f776341 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.685937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7ec44-1765-4ce0-bde0-bd213f776341 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.686760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7ec44-1765-4ce0-bde0-bd213f776341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.774128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f4c5d-1fbe-4e3c-ab7b-22a0bc2dbeed None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:46.795053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7ec44-1765-4ce0-bde0-bd213f776341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:46.796625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7ec44-1765-4ce0-bde0-bd213f776341 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:46.813790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a499-a502-45df-9b28-73e73222782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:46.814865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a499-a502-45df-9b28-73e73222782a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.815347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a499-a502-45df-9b28-73e73222782a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.815816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a499-a502-45df-9b28-73e73222782a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.816921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5a499-a502-45df-9b28-73e73222782a None admin] RBAC: Adding query filter params (role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=6792456cc69f4d958161cf85839a9443, user.id=934372073e7043e799dbf937d35e0be5) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:46.817438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5a499-a502-45df-9b28-73e73222782a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:46.819113 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5a499-a502-45df-9b28-73e73222782a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:46.825784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 138/268] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:46 2022] GET /identity/v3/role_assignments?user.id=934372073e7043e799dbf937d35e0be5&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:46.827468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:46.828102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77645e-e545-46b8-afbe-f4da375dd92e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.828827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77645e-e545-46b8-afbe-f4da375dd92e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.829444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77645e-e545-46b8-afbe-f4da375dd92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.849979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4c77645e-e545-46b8-afbe-f4da375dd92e None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:46.851628 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4c77645e-e545-46b8-afbe-f4da375dd92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:46.856284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:46.941496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 131/269] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:46.941496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86db733-7b09-4c57-a727-ced84b122053 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:46.941496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86db733-7b09-4c57-a727-ced84b122053 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:46.941496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86db733-7b09-4c57-a727-ced84b122053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:46.962584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b86db733-7b09-4c57-a727-ced84b122053 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:46.963796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b86db733-7b09-4c57-a727-ced84b122053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:47.012598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 139/270] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:47.013493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77645e-e545-46b8-afbe-f4da375dd92e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:47.051162 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 132/271] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:47.054634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86db733-7b09-4c57-a727-ced84b122053 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:47.133796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:47.196153 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86db733-7b09-4c57-a727-ced84b122053 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:47.213796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77645e-e545-46b8-afbe-f4da375dd92e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:47.240922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20234a0c-5d3f-4d59-a62f-90b7c2515163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:47.242197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20234a0c-5d3f-4d59-a62f-90b7c2515163 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.242479 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20234a0c-5d3f-4d59-a62f-90b7c2515163 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.242808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20234a0c-5d3f-4d59-a62f-90b7c2515163 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.257209 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20234a0c-5d3f-4d59-a62f-90b7c2515163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:47.258859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ce764-4736-4b2a-804a-981d72d4ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:47.259731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce764-4736-4b2a-804a-981d72d4ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.260015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce764-4736-4b2a-804a-981d72d4ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.260293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce764-4736-4b2a-804a-981d72d4ecd4 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.261508 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ce764-4736-4b2a-804a-981d72d4ecd4 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:47.262968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ce764-4736-4b2a-804a-981d72d4ecd4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:47.265034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 140/272] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:47 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:47.266183 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ce764-4736-4b2a-804a-981d72d4ecd4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-20234a0c-5d3f-4d59-a62f-90b7c2515163 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:47.269807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:47.270925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:47.272001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:47.273289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 133/273] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:47.274648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20234a0c-5d3f-4d59-a62f-90b7c2515163 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:47.279654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:47.393210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ce764-4736-4b2a-804a-981d72d4ecd4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:47.395692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20234a0c-5d3f-4d59-a62f-90b7c2515163 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:47.410534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:47.433541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949d1b-cdd6-4aa7-9a60-d6ec567d5b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:47.434023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf3c5f-78f6-488c-9a39-5b872af4dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:47.434340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949d1b-cdd6-4aa7-9a60-d6ec567d5b19 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.434624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949d1b-cdd6-4aa7-9a60-d6ec567d5b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.434720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf3c5f-78f6-488c-9a39-5b872af4dc7f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.434902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949d1b-cdd6-4aa7-9a60-d6ec567d5b19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.435009 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf3c5f-78f6-488c-9a39-5b872af4dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.435204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf3c5f-78f6-488c-9a39-5b872af4dc7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.436684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f949d1b-cdd6-4aa7-9a60-d6ec567d5b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:47.436813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf3c5f-78f6-488c-9a39-5b872af4dc7f None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=6792456cc69f4d958161cf85839a9443, user.id=934372073e7043e799dbf937d35e0be5) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:47.437149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf3c5f-78f6-488c-9a39-5b872af4dc7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:47.438280 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f949d1b-cdd6-4aa7-9a60-d6ec567d5b19 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:47.438926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf3c5f-78f6-488c-9a39-5b872af4dc7f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:47.440218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 141/274] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:47.440808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949d1b-cdd6-4aa7-9a60-d6ec567d5b19 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:47.453498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 134/275] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:47 2022] GET /identity/v3/role_assignments?user.id=934372073e7043e799dbf937d35e0be5&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:47.453498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a940c2-158e-43ef-8e80-6cb6fb6c50e2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.453498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a940c2-158e-43ef-8e80-6cb6fb6c50e2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.453498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a940c2-158e-43ef-8e80-6cb6fb6c50e2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.455729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 135/276] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:47.455729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a940c2-158e-43ef-8e80-6cb6fb6c50e2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:47.540691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:47.571001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949d1b-cdd6-4aa7-9a60-d6ec567d5b19 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:47.607709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a940c2-158e-43ef-8e80-6cb6fb6c50e2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:47.612601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d7c7a-672e-4ff5-96b2-fe3a0754c742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:47.613443 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d7c7a-672e-4ff5-96b2-fe3a0754c742 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.613859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d7c7a-672e-4ff5-96b2-fe3a0754c742 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.614244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d7c7a-672e-4ff5-96b2-fe3a0754c742 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.615120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d7c7a-672e-4ff5-96b2-fe3a0754c742 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:47.615537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d7c7a-672e-4ff5-96b2-fe3a0754c742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:47.617399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d7c7a-672e-4ff5-96b2-fe3a0754c742 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:47.630568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 142/277] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:47.632011 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10c9a7-94e7-41b5-a5e7-3d6adb3914cd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.632405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10c9a7-94e7-41b5-a5e7-3d6adb3914cd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.632787 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10c9a7-94e7-41b5-a5e7-3d6adb3914cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.650856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ff10c9a7-94e7-41b5-a5e7-3d6adb3914cd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:47.652109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff10c9a7-94e7-41b5-a5e7-3d6adb3914cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:47.652989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc73a3c-91c6-4b02-ae65-c1da243dfbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:47.653685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc73a3c-91c6-4b02-ae65-c1da243dfbca None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.653970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc73a3c-91c6-4b02-ae65-c1da243dfbca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.654249 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc73a3c-91c6-4b02-ae65-c1da243dfbca None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.655220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc73a3c-91c6-4b02-ae65-c1da243dfbca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:47.657774 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc73a3c-91c6-4b02-ae65-c1da243dfbca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:47.683776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 136/278] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 14:59:47 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:47.688046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc73a3c-91c6-4b02-ae65-c1da243dfbca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:47.741741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:47.759055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 143/279] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:47.786752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10c9a7-94e7-41b5-a5e7-3d6adb3914cd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:47.854169 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc73a3c-91c6-4b02-ae65-c1da243dfbca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:47.875051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:47.907026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ae23-3a3a-46b4-99c4-c399feacecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:47.907836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ae23-3a3a-46b4-99c4-c399feacecb4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.908116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ae23-3a3a-46b4-99c4-c399feacecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.908389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ae23-3a3a-46b4-99c4-c399feacecb4 None admin] PATH_INFO: `/v3/users/c54f098f119f48f2b5d7ed3f1e024ae3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.916209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10c9a7-94e7-41b5-a5e7-3d6adb3914cd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:47.926986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ae23-3a3a-46b4-99c4-c399feacecb4 None admin] RBAC: Authorizing `identity:get_user(user_id=c54f098f119f48f2b5d7ed3f1e024ae3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:47.930734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ae23-3a3a-46b4-99c4-c399feacecb4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:47.933153 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 137/280] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:47 2022] GET /identity/v3/users/c54f098f119f48f2b5d7ed3f1e024ae3 => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:47.939046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ae23-3a3a-46b4-99c4-c399feacecb4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:47.961207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a451f9-f16d-44fa-b87a-bd74c53271c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:47.962298 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a451f9-f16d-44fa-b87a-bd74c53271c3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:47.962745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a451f9-f16d-44fa-b87a-bd74c53271c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:47.963178 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a451f9-f16d-44fa-b87a-bd74c53271c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:47.977243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a451f9-f16d-44fa-b87a-bd74c53271c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-79a451f9-f16d-44fa-b87a-bd74c53271c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:47.987992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:47.988953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:47.989910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:47.993313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 144/281] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:47.997611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a451f9-f16d-44fa-b87a-bd74c53271c3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:48.066584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:48.075918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ae23-3a3a-46b4-99c4-c399feacecb4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:48.120579 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47664d7-3adb-4b18-8c65-5c86328e3c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:48.121246 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47664d7-3adb-4b18-8c65-5c86328e3c8a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:48.121677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47664d7-3adb-4b18-8c65-5c86328e3c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:48.121963 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47664d7-3adb-4b18-8c65-5c86328e3c8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:48.122809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47664d7-3adb-4b18-8c65-5c86328e3c8a None admin] RBAC: Adding query filter params (role.id=fefbf89e7cb947a4a9651f4554c49df8, user.id=c54f098f119f48f2b5d7ed3f1e024ae3, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:48.123123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47664d7-3adb-4b18-8c65-5c86328e3c8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:48.126012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47664d7-3adb-4b18-8c65-5c86328e3c8a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:48.137203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a451f9-f16d-44fa-b87a-bd74c53271c3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:48.143836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 138/282] 10.222.0.90 () {56 vars in 1308 bytes} [Tue Jun 21 14:59:47 2022] GET /identity/v3/role_assignments?user.id=c54f098f119f48f2b5d7ed3f1e024ae3&scope.system=all&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:48.176711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:48.191958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd3298-4b47-46f1-b8fa-09ddfa52c48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:48.192659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd3298-4b47-46f1-b8fa-09ddfa52c48a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:48.192952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd3298-4b47-46f1-b8fa-09ddfa52c48a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:48.193235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd3298-4b47-46f1-b8fa-09ddfa52c48a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:48.194050 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd3298-4b47-46f1-b8fa-09ddfa52c48a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:48.194369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd3298-4b47-46f1-b8fa-09ddfa52c48a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:48.195800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd3298-4b47-46f1-b8fa-09ddfa52c48a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:48.206830 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 145/283] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:48.212759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47664d7-3adb-4b18-8c65-5c86328e3c8a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:48.361607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47664d7-3adb-4b18-8c65-5c86328e3c8a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:48.407754 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d94f2-01f8-4179-b008-4853fc3cb992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:48.408643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d94f2-01f8-4179-b008-4853fc3cb992 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:48.408928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d94f2-01f8-4179-b008-4853fc3cb992 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:48.409208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d94f2-01f8-4179-b008-4853fc3cb992 None admin] PATH_INFO: `/v3/users/010aeeaaddee42869c3cadaabb9946af` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:48.410449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d94f2-01f8-4179-b008-4853fc3cb992 None admin] RBAC: Authorizing `identity:get_user(user_id=010aeeaaddee42869c3cadaabb9946af)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:48.412009 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d94f2-01f8-4179-b008-4853fc3cb992 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:48.413891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 139/284] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:48 2022] GET /identity/v3/users/010aeeaaddee42869c3cadaabb9946af => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:48.419341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd3298-4b47-46f1-b8fa-09ddfa52c48a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:48.462199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642b851-a9e5-41ef-bbd8-17a78cb9f083 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:48.462491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642b851-a9e5-41ef-bbd8-17a78cb9f083 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:48.462775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642b851-a9e5-41ef-bbd8-17a78cb9f083 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:48.464447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 140/285] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:48.479174 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802c2f-1982-4832-a92a-bb0c1cd8e301 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:48.479527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802c2f-1982-4832-a92a-bb0c1cd8e301 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:48.479743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802c2f-1982-4832-a92a-bb0c1cd8e301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:48.507071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-51802c2f-1982-4832-a92a-bb0c1cd8e301 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:48.508541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-51802c2f-1982-4832-a92a-bb0c1cd8e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:48.550756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:48.551380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd3298-4b47-46f1-b8fa-09ddfa52c48a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:48.599562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 141/286] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:48.628471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802c2f-1982-4832-a92a-bb0c1cd8e301 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:48.635553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757f410-daf0-4f91-a529-09c0771e202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:48.636677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f410-daf0-4f91-a529-09c0771e202d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:48.637197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f410-daf0-4f91-a529-09c0771e202d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:48.637696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f410-daf0-4f91-a529-09c0771e202d None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:48.642467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757f410-daf0-4f91-a529-09c0771e202d None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:48.644175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757f410-daf0-4f91-a529-09c0771e202d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:48.646235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 146/287] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:48 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:48.663822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757f410-daf0-4f91-a529-09c0771e202d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:48.753188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802c2f-1982-4832-a92a-bb0c1cd8e301 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:48.794216 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c74ac-8a75-4465-9c64-8df1359b5652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:48.796841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c74ac-8a75-4465-9c64-8df1359b5652 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:48.797264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c74ac-8a75-4465-9c64-8df1359b5652 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:48.797587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c74ac-8a75-4465-9c64-8df1359b5652 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:48.809463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c74ac-8a75-4465-9c64-8df1359b5652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-041c74ac-8a75-4465-9c64-8df1359b5652 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:48.818503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:48.819471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:48.820276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 142/288] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:48.825844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c74ac-8a75-4465-9c64-8df1359b5652 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:48.853889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:48.871400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:48.939160 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c74ac-8a75-4465-9c64-8df1359b5652 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:48.977252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5790c-bcfb-4ef1-a33b-835af3436cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:48.978407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5790c-bcfb-4ef1-a33b-835af3436cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:48.978905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5790c-bcfb-4ef1-a33b-835af3436cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:48.979380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5790c-bcfb-4ef1-a33b-835af3436cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:48.980808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5790c-bcfb-4ef1-a33b-835af3436cd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:48.981335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5790c-bcfb-4ef1-a33b-835af3436cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:48.983339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5790c-bcfb-4ef1-a33b-835af3436cd7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:48.995183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 143/289] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:49.001432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5790c-bcfb-4ef1-a33b-835af3436cd7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:49.018680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757f410-daf0-4f91-a529-09c0771e202d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:49.073158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90611e93-082b-4d65-ac5c-e7982b12332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:49.074463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90611e93-082b-4d65-ac5c-e7982b12332d None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:49.074946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90611e93-082b-4d65-ac5c-e7982b12332d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:49.075432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90611e93-082b-4d65-ac5c-e7982b12332d None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443/users/010aeeaaddee42869c3cadaabb9946af/roles/8ac3052831b845bc88d5e829f84cb382` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:49.082541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90611e93-082b-4d65-ac5c-e7982b12332d None admin] RBAC: Authorizing `identity:create_grant(project_id=6792456cc69f4d958161cf85839a9443, user_id=010aeeaaddee42869c3cadaabb9946af, role_id=8ac3052831b845bc88d5e829f84cb382)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:49.084289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90611e93-082b-4d65-ac5c-e7982b12332d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:49.107280 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 147/290] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 14:59:48 2022] PUT /identity/v3/projects/6792456cc69f4d958161cf85839a9443/users/010aeeaaddee42869c3cadaabb9946af/roles/8ac3052831b845bc88d5e829f84cb382 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:49.121844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:49.151872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5790c-bcfb-4ef1-a33b-835af3436cd7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:49.194311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56eb53-26ac-463e-a777-78afb010a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:49.195261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56eb53-26ac-463e-a777-78afb010a57f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:49.195550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56eb53-26ac-463e-a777-78afb010a57f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:49.195830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56eb53-26ac-463e-a777-78afb010a57f None admin] PATH_INFO: `/v3/users/932b7ab6cf164dda9154103b60406420` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:49.197122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56eb53-26ac-463e-a777-78afb010a57f None admin] RBAC: Authorizing `identity:get_user(user_id=932b7ab6cf164dda9154103b60406420)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:49.198650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56eb53-26ac-463e-a777-78afb010a57f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:49.205662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 144/291] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:49 2022] GET /identity/v3/users/932b7ab6cf164dda9154103b60406420 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:49.207651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90611e93-082b-4d65-ac5c-e7982b12332d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:49.348872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90611e93-082b-4d65-ac5c-e7982b12332d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:49.370001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:49.390206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274ad69-6d9e-47e5-94b9-c2123fe04101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:49.390876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274ad69-6d9e-47e5-94b9-c2123fe04101 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:49.391157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274ad69-6d9e-47e5-94b9-c2123fe04101 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:49.391435 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274ad69-6d9e-47e5-94b9-c2123fe04101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:49.462772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274ad69-6d9e-47e5-94b9-c2123fe04101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:49.464249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274ad69-6d9e-47e5-94b9-c2123fe04101 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:49.568230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 148/292] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:49.574066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56eb53-26ac-463e-a777-78afb010a57f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:49.728929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56eb53-26ac-463e-a777-78afb010a57f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:49.780899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2b732-51f3-4375-98fa-b90586797fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:49.782182 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2b732-51f3-4375-98fa-b90586797fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:49.782663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2b732-51f3-4375-98fa-b90586797fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:49.783157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2b732-51f3-4375-98fa-b90586797fd1 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:49.790249 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2b732-51f3-4375-98fa-b90586797fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:49.791962 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2b732-51f3-4375-98fa-b90586797fd1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:49.794234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 145/293] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:49 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:49.800690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274ad69-6d9e-47e5-94b9-c2123fe04101 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:49.824759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:49.949920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274ad69-6d9e-47e5-94b9-c2123fe04101 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:50.002071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f845d9-f1bd-4f48-aea8-6aefefd1bbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:50.002664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f845d9-f1bd-4f48-aea8-6aefefd1bbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:50.002951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f845d9-f1bd-4f48-aea8-6aefefd1bbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:50.003235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f845d9-f1bd-4f48-aea8-6aefefd1bbf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:50.004075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f845d9-f1bd-4f48-aea8-6aefefd1bbf6 None admin] RBAC: Adding query filter params (role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=6792456cc69f4d958161cf85839a9443, user.id=932b7ab6cf164dda9154103b60406420) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:50.004389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f845d9-f1bd-4f48-aea8-6aefefd1bbf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:50.005860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f845d9-f1bd-4f48-aea8-6aefefd1bbf6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:50.015077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 149/294] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:49 2022] GET /identity/v3/role_assignments?user.id=932b7ab6cf164dda9154103b60406420&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:50.222660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e2ba-90a1-4e48-82a7-8d6e5e1053f0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:50.223170 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e2ba-90a1-4e48-82a7-8d6e5e1053f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:50.223246 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5e2ba-90a1-4e48-82a7-8d6e5e1053f0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:50.224881 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 146/295] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:50.240050 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44ee22-078e-493f-830f-b9ad42b81ccd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:50.240343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44ee22-078e-493f-830f-b9ad42b81ccd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:50.240618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44ee22-078e-493f-830f-b9ad42b81ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:50.262687 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eb44ee22-078e-493f-830f-b9ad42b81ccd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:50.264008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eb44ee22-078e-493f-830f-b9ad42b81ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:50.345388 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 150/296] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:50.367693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5e2ba-90a1-4e48-82a7-8d6e5e1053f0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:50.382177 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:50.484939 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5e2ba-90a1-4e48-82a7-8d6e5e1053f0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:50.523197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb43d05-6252-457b-9286-a2fbb5b6946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:50.523980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb43d05-6252-457b-9286-a2fbb5b6946a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:50.524249 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb43d05-6252-457b-9286-a2fbb5b6946a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:50.524833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb43d05-6252-457b-9286-a2fbb5b6946a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:50.526923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb43d05-6252-457b-9286-a2fbb5b6946a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:50.528477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb43d05-6252-457b-9286-a2fbb5b6946a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:50.531048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 147/297] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:50.536711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44ee22-078e-493f-830f-b9ad42b81ccd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:50.551766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:50.566841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697254d-c86e-48af-b29a-4c9a24afcaab None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:50.567148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697254d-c86e-48af-b29a-4c9a24afcaab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:50.567404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697254d-c86e-48af-b29a-4c9a24afcaab None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:50.568782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 148/298] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:50.574043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98385b8-ec1f-4a36-b492-749bb2b5fd09 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:50.574333 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98385b8-ec1f-4a36-b492-749bb2b5fd09 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:50.574614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98385b8-ec1f-4a36-b492-749bb2b5fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:50.592147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b98385b8-ec1f-4a36-b492-749bb2b5fd09 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:50.594466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b98385b8-ec1f-4a36-b492-749bb2b5fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:50.676746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44ee22-078e-493f-830f-b9ad42b81ccd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:50.690817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 149/299] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:50.714432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98385b8-ec1f-4a36-b492-749bb2b5fd09 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:50.719805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37dae5-0c01-4c0d-9c3e-0c24f61f6b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:50.720486 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37dae5-0c01-4c0d-9c3e-0c24f61f6b93 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:50.720770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37dae5-0c01-4c0d-9c3e-0c24f61f6b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:50.721047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37dae5-0c01-4c0d-9c3e-0c24f61f6b93 None admin] PATH_INFO: `/v3/groups` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:50.721790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37dae5-0c01-4c0d-9c3e-0c24f61f6b93 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:50.723341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37dae5-0c01-4c0d-9c3e-0c24f61f6b93 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:50.741819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:50.742133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 151/300] 10.222.0.90 () {60 vars in 1134 bytes} [Tue Jun 21 14:59:50 2022] POST /identity/v3/groups => generated 229 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:50.839072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98385b8-ec1f-4a36-b492-749bb2b5fd09 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:50.878324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4508d-81c7-49e5-928d-fab9023d5340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:50.879134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4508d-81c7-49e5-928d-fab9023d5340 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:50.879417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4508d-81c7-49e5-928d-fab9023d5340 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:50.879693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4508d-81c7-49e5-928d-fab9023d5340 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:50.892217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4508d-81c7-49e5-928d-fab9023d5340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4cf4508d-81c7-49e5-928d-fab9023d5340 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:50.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:50.901364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:50.902234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 150/301] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:50.907901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37dae5-0c01-4c0d-9c3e-0c24f61f6b93 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:50.997792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:51.038707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37dae5-0c01-4c0d-9c3e-0c24f61f6b93 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:51.059337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a284730-8b69-4cc4-91ec-13105ca5d63d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.059641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a284730-8b69-4cc4-91ec-13105ca5d63d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.059906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a284730-8b69-4cc4-91ec-13105ca5d63d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.062226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 151/302] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:51.067242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4549-d867-431c-8d25-ab05a27509e4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.067533 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4549-d867-431c-8d25-ab05a27509e4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.067814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4549-d867-431c-8d25-ab05a27509e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.076155 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0bfa8-1b44-488a-8cce-77c66027f0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:51.077893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0bfa8-1b44-488a-8cce-77c66027f0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.078401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0bfa8-1b44-488a-8cce-77c66027f0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.078852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0bfa8-1b44-488a-8cce-77c66027f0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.079783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0bfa8-1b44-488a-8cce-77c66027f0b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:51.080292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0bfa8-1b44-488a-8cce-77c66027f0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:51.081879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0bfa8-1b44-488a-8cce-77c66027f0b6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:51.086361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a79b4549-d867-431c-8d25-ab05a27509e4 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:51.087547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a79b4549-d867-431c-8d25-ab05a27509e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:51.091996 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 152/303] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:51.098024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0bfa8-1b44-488a-8cce-77c66027f0b6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:51.160485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:51.173763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 152/304] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:51.191460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4549-d867-431c-8d25-ab05a27509e4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:51.224069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0bfa8-1b44-488a-8cce-77c66027f0b6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:51.269642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152380d-98f6-48e3-ba58-6165027d1353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:51.270983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152380d-98f6-48e3-ba58-6165027d1353 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.271930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152380d-98f6-48e3-ba58-6165027d1353 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.272483 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152380d-98f6-48e3-ba58-6165027d1353 None admin] PATH_INFO: `/v3/users/28320a67b6cb4b7a87562e03a2d68f11` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.276450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:51.294256 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152380d-98f6-48e3-ba58-6165027d1353 None admin] RBAC: Authorizing `identity:get_user(user_id=28320a67b6cb4b7a87562e03a2d68f11)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:51.296384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152380d-98f6-48e3-ba58-6165027d1353 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:51.298813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 153/305] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:51 2022] GET /identity/v3/users/28320a67b6cb4b7a87562e03a2d68f11 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:51.307153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152380d-98f6-48e3-ba58-6165027d1353 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:51.319720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4549-d867-431c-8d25-ab05a27509e4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:51.362770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5b20c-c745-4ea1-afdd-770f87ce01cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:51.364019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b20c-c745-4ea1-afdd-770f87ce01cd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.364513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b20c-c745-4ea1-afdd-770f87ce01cd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.364984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b20c-c745-4ea1-afdd-770f87ce01cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.378744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5b20c-c745-4ea1-afdd-770f87ce01cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f7f5b20c-c745-4ea1-afdd-770f87ce01cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:51.387526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:51.388671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:51.389927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:51.393065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 153/306] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:51.399254 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5b20c-c745-4ea1-afdd-770f87ce01cd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:51.452024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152380d-98f6-48e3-ba58-6165027d1353 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:51.486175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:51.491419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c0bbe-f265-47ad-b4bf-acff304585fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:51.492090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c0bbe-f265-47ad-b4bf-acff304585fe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.492373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c0bbe-f265-47ad-b4bf-acff304585fe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.492652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c0bbe-f265-47ad-b4bf-acff304585fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.493603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c0bbe-f265-47ad-b4bf-acff304585fe None admin] RBAC: Adding query filter params (role.id=8ac3052831b845bc88d5e829f84cb382, user.id=28320a67b6cb4b7a87562e03a2d68f11, scope.system=all) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:51.493921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c0bbe-f265-47ad-b4bf-acff304585fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:51.495432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c0bbe-f265-47ad-b4bf-acff304585fe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:51.509285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 154/307] 10.222.0.90 () {56 vars in 1308 bytes} [Tue Jun 21 14:59:51 2022] GET /identity/v3/role_assignments?user.id=28320a67b6cb4b7a87562e03a2d68f11&scope.system=all&role.id=8ac3052831b845bc88d5e829f84cb382 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:51.560472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5b20c-c745-4ea1-afdd-770f87ce01cd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:51.605917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83384869-5eef-48b5-a25c-6ce29710587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:51.607214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83384869-5eef-48b5-a25c-6ce29710587c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.608638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83384869-5eef-48b5-a25c-6ce29710587c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.609556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83384869-5eef-48b5-a25c-6ce29710587c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.611033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83384869-5eef-48b5-a25c-6ce29710587c None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:51.611619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83384869-5eef-48b5-a25c-6ce29710587c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:51.613708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83384869-5eef-48b5-a25c-6ce29710587c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:51.626200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 154/308] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:51.633129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c0bbe-f265-47ad-b4bf-acff304585fe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:51.710932 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:51.713556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998feb06-bdc1-4503-bd0d-5f6b96e5f17e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.713881 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998feb06-bdc1-4503-bd0d-5f6b96e5f17e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.714220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998feb06-bdc1-4503-bd0d-5f6b96e5f17e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.717955 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 155/309] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:51.722131 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8998339-7cc0-4b5a-8040-71f4d74c6859 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.722564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8998339-7cc0-4b5a-8040-71f4d74c6859 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.722752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8998339-7cc0-4b5a-8040-71f4d74c6859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.747353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a8998339-7cc0-4b5a-8040-71f4d74c6859 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:51.749833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a8998339-7cc0-4b5a-8040-71f4d74c6859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:51.770321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c0bbe-f265-47ad-b4bf-acff304585fe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:51.814510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683c35f-d42c-480c-9955-6461587b3b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:51.815423 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683c35f-d42c-480c-9955-6461587b3b7e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:51.815720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683c35f-d42c-480c-9955-6461587b3b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:51.816002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683c35f-d42c-480c-9955-6461587b3b7e None admin] PATH_INFO: `/v3/users/c54f098f119f48f2b5d7ed3f1e024ae3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:51.817211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683c35f-d42c-480c-9955-6461587b3b7e None admin] RBAC: Authorizing `identity:get_user(user_id=c54f098f119f48f2b5d7ed3f1e024ae3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:51.818697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683c35f-d42c-480c-9955-6461587b3b7e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:51.825129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 155/310] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:51 2022] GET /identity/v3/users/c54f098f119f48f2b5d7ed3f1e024ae3 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:51.826162 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683c35f-d42c-480c-9955-6461587b3b7e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:51.846738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 156/311] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:51.873097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8998339-7cc0-4b5a-8040-71f4d74c6859 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:51.942148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:51.956478 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683c35f-d42c-480c-9955-6461587b3b7e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:51.987950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:52.001977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc805006-6e29-4497-ba20-32dd52f1fd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:52.002855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc805006-6e29-4497-ba20-32dd52f1fd7c None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:52.003141 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc805006-6e29-4497-ba20-32dd52f1fd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:52.003528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc805006-6e29-4497-ba20-32dd52f1fd7c None admin] PATH_INFO: `/v3/system/users/c54f098f119f48f2b5d7ed3f1e024ae3/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:52.005571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc805006-6e29-4497-ba20-32dd52f1fd7c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c54f098f119f48f2b5d7ed3f1e024ae3, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:52.007823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc805006-6e29-4497-ba20-32dd52f1fd7c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:52.008323 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8998339-7cc0-4b5a-8040-71f4d74c6859 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:52.024892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 156/312] 10.222.0.90 () {58 vars in 1334 bytes} [Tue Jun 21 14:59:51 2022] PUT /identity/v3/system/users/c54f098f119f48f2b5d7ed3f1e024ae3/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 14:59:52.053601 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be165ee1-4e1a-4db6-a3aa-82880290bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:52.055002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165ee1-4e1a-4db6-a3aa-82880290bec9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:52.055515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165ee1-4e1a-4db6-a3aa-82880290bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:52.056702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165ee1-4e1a-4db6-a3aa-82880290bec9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:52.073677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be165ee1-4e1a-4db6-a3aa-82880290bec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-be165ee1-4e1a-4db6-a3aa-82880290bec9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:52.082846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:52.084314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:52.085850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 157/313] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:52.096345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc805006-6e29-4497-ba20-32dd52f1fd7c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:52.271118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc805006-6e29-4497-ba20-32dd52f1fd7c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:52.330190 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841dfc6-5697-43bf-92c9-c7de79f5cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:52.331400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841dfc6-5697-43bf-92c9-c7de79f5cf26 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:52.331928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841dfc6-5697-43bf-92c9-c7de79f5cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:52.332352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841dfc6-5697-43bf-92c9-c7de79f5cf26 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:52.333277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841dfc6-5697-43bf-92c9-c7de79f5cf26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:52.333759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841dfc6-5697-43bf-92c9-c7de79f5cf26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:52.335409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841dfc6-5697-43bf-92c9-c7de79f5cf26 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:52.351361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 157/314] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:52.363433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be165ee1-4e1a-4db6-a3aa-82880290bec9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:52.520914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be165ee1-4e1a-4db6-a3aa-82880290bec9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:52.536469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:52.566457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfdfa7-1397-41bd-aab6-02660bf81ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:52.567640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfdfa7-1397-41bd-aab6-02660bf81ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:52.568156 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfdfa7-1397-41bd-aab6-02660bf81ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:52.568630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfdfa7-1397-41bd-aab6-02660bf81ae7 None admin] PATH_INFO: `/v3/users/010aeeaaddee42869c3cadaabb9946af` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:52.570630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfdfa7-1397-41bd-aab6-02660bf81ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=010aeeaaddee42869c3cadaabb9946af)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:52.573426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfdfa7-1397-41bd-aab6-02660bf81ae7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:52.575728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 158/315] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:52 2022] GET /identity/v3/users/010aeeaaddee42869c3cadaabb9946af => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:52.584049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841dfc6-5697-43bf-92c9-c7de79f5cf26 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:52.664567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:52.776992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841dfc6-5697-43bf-92c9-c7de79f5cf26 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:52.849112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb949646-1843-4870-8099-b094b3c96359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:52.849929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb949646-1843-4870-8099-b094b3c96359 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:52.850212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb949646-1843-4870-8099-b094b3c96359 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:52.850493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb949646-1843-4870-8099-b094b3c96359 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:52.946221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb949646-1843-4870-8099-b094b3c96359 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:52.947829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb949646-1843-4870-8099-b094b3c96359 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:53.012490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:53.080149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 158/316] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:53.085727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfdfa7-1397-41bd-aab6-02660bf81ae7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:53.215771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfdfa7-1397-41bd-aab6-02660bf81ae7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:53.278410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c674ad-6405-42c6-84a9-14b45dd3bf1e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:53.279288 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c674ad-6405-42c6-84a9-14b45dd3bf1e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:53.280275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c674ad-6405-42c6-84a9-14b45dd3bf1e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:53.280428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6106e2a-d6e3-4776-a00e-cc82775ed714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:53.281996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6106e2a-d6e3-4776-a00e-cc82775ed714 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:53.282499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6106e2a-d6e3-4776-a00e-cc82775ed714 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:53.283107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6106e2a-d6e3-4776-a00e-cc82775ed714 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:53.283332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 159/317] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:53.287900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6106e2a-d6e3-4776-a00e-cc82775ed714 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:53.289186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd51bf-1f8b-4a03-81e9-553a89644afd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:53.289730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd51bf-1f8b-4a03-81e9-553a89644afd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:53.289915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6106e2a-d6e3-4776-a00e-cc82775ed714 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:53.290391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd51bf-1f8b-4a03-81e9-553a89644afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:53.293531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 159/318] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:53 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:53.301536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6106e2a-d6e3-4776-a00e-cc82775ed714 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:53.327725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-64cd51bf-1f8b-4a03-81e9-553a89644afd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:53.329280 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-64cd51bf-1f8b-4a03-81e9-553a89644afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:53.377217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:53.451015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 160/319] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:53.465025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6106e2a-d6e3-4776-a00e-cc82775ed714 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:53.486440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd51bf-1f8b-4a03-81e9-553a89644afd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:53.527266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da721c73-64fd-4aa7-a376-4b3b9a01db59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:53.528995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da721c73-64fd-4aa7-a376-4b3b9a01db59 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:53.530600 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da721c73-64fd-4aa7-a376-4b3b9a01db59 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:53.530985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da721c73-64fd-4aa7-a376-4b3b9a01db59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:53.532615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da721c73-64fd-4aa7-a376-4b3b9a01db59 None admin] RBAC: Adding query filter params (role.id=8ac3052831b845bc88d5e829f84cb382, scope.project.id=6792456cc69f4d958161cf85839a9443, user.id=010aeeaaddee42869c3cadaabb9946af) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:53.533176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da721c73-64fd-4aa7-a376-4b3b9a01db59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:53.535328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da721c73-64fd-4aa7-a376-4b3b9a01db59 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:53.553525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 160/320] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 14:59:53 2022] GET /identity/v3/role_assignments?user.id=010aeeaaddee42869c3cadaabb9946af&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=8ac3052831b845bc88d5e829f84cb382 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:53.616992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:53.653659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd51bf-1f8b-4a03-81e9-553a89644afd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:53.703163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255919c-aab4-4b5c-b7ae-47977807b1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:53.705130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255919c-aab4-4b5c-b7ae-47977807b1ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:53.705706 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255919c-aab4-4b5c-b7ae-47977807b1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:53.706179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255919c-aab4-4b5c-b7ae-47977807b1ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:53.707781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255919c-aab4-4b5c-b7ae-47977807b1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:53.709529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255919c-aab4-4b5c-b7ae-47977807b1ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:53.711450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 161/321] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 14:59:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:53.718775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da721c73-64fd-4aa7-a376-4b3b9a01db59 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:53.849367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da721c73-64fd-4aa7-a376-4b3b9a01db59 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:53.861817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:53.898553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad1d2e-e338-47f9-998f-6ba6b8ed77a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:53.899347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad1d2e-e338-47f9-998f-6ba6b8ed77a3 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:53.899671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad1d2e-e338-47f9-998f-6ba6b8ed77a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:53.899955 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad1d2e-e338-47f9-998f-6ba6b8ed77a3 None admin] PATH_INFO: `/v3/groups` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:53.900985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad1d2e-e338-47f9-998f-6ba6b8ed77a3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:53.903703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad1d2e-e338-47f9-998f-6ba6b8ed77a3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:53.932825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 161/322] 10.222.0.90 () {60 vars in 1134 bytes} [Tue Jun 21 14:59:53 2022] POST /identity/v3/groups => generated 226 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 14:59:54.056889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a56b9-8f75-4250-aee6-8f88c648e110 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:54.057225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a56b9-8f75-4250-aee6-8f88c648e110 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:54.057445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a56b9-8f75-4250-aee6-8f88c648e110 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:54.059084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 162/323] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:54.066629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579656-22e3-4763-b2db-fe8c58372a5b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:54.066943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579656-22e3-4763-b2db-fe8c58372a5b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:54.067278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579656-22e3-4763-b2db-fe8c58372a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:54.092890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b6579656-22e3-4763-b2db-fe8c58372a5b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:54.094303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b6579656-22e3-4763-b2db-fe8c58372a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:54.198341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 162/324] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:54.229184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a56b9-8f75-4250-aee6-8f88c648e110 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:54.407929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a56b9-8f75-4250-aee6-8f88c648e110 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:54.478308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc658d56-3fe2-4b06-b33f-95c73939e97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:54.479670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc658d56-3fe2-4b06-b33f-95c73939e97d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:54.480170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc658d56-3fe2-4b06-b33f-95c73939e97d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:54.480701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc658d56-3fe2-4b06-b33f-95c73939e97d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:54.501824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc658d56-3fe2-4b06-b33f-95c73939e97d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fc658d56-3fe2-4b06-b33f-95c73939e97d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:54.517378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:54.518406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 14:59:54.519273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:54.520539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 163/325] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:54.526305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579656-22e3-4763-b2db-fe8c58372a5b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:54.561938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6cff3-9d89-4fe7-90b3-fdbfd723b72b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:54.562405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6cff3-9d89-4fe7-90b3-fdbfd723b72b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:54.562847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6cff3-9d89-4fe7-90b3-fdbfd723b72b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:54.565682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 164/326] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 14:59:54.572420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885c0a9-c5a9-470e-8257-f7d9983f7277 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:54.572751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885c0a9-c5a9-470e-8257-f7d9983f7277 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:54.573056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885c0a9-c5a9-470e-8257-f7d9983f7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:54.604466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1885c0a9-c5a9-470e-8257-f7d9983f7277 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:54.607030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1885c0a9-c5a9-470e-8257-f7d9983f7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:54.610694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:54.721786 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 165/327] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 14:59:54.749126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885c0a9-c5a9-470e-8257-f7d9983f7277 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:54.770108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:54.777288 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579656-22e3-4763-b2db-fe8c58372a5b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:54.850088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c040c4-f424-4e93-bf04-a497bdd9d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:54.851946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c040c4-f424-4e93-bf04-a497bdd9d385 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:54.852564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c040c4-f424-4e93-bf04-a497bdd9d385 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:54.853062 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c040c4-f424-4e93-bf04-a497bdd9d385 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:54.854492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c040c4-f424-4e93-bf04-a497bdd9d385 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:54.855034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c040c4-f424-4e93-bf04-a497bdd9d385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:54.859081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c040c4-f424-4e93-bf04-a497bdd9d385 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:54.877181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 163/328] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:54.886346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c040c4-f424-4e93-bf04-a497bdd9d385 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:55.029119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885c0a9-c5a9-470e-8257-f7d9983f7277 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:55.100035 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c040c4-f424-4e93-bf04-a497bdd9d385 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:55.123824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0e54d-441a-4dbf-b2e7-1f7b78e1c432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:55.126979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0e54d-441a-4dbf-b2e7-1f7b78e1c432 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:55.127455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0e54d-441a-4dbf-b2e7-1f7b78e1c432 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:55.127936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0e54d-441a-4dbf-b2e7-1f7b78e1c432 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:55.146809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bb4d-8639-40ae-9b5a-b4acf8e7b7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:55.147579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:55.148767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bb4d-8639-40ae-9b5a-b4acf8e7b7cf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:55.149198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bb4d-8639-40ae-9b5a-b4acf8e7b7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:55.149507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bb4d-8639-40ae-9b5a-b4acf8e7b7cf None admin] PATH_INFO: `/v3/users/28320a67b6cb4b7a87562e03a2d68f11` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:55.151816 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0bb4d-8639-40ae-9b5a-b4acf8e7b7cf None admin] RBAC: Authorizing `identity:get_user(user_id=28320a67b6cb4b7a87562e03a2d68f11)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:55.153415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0bb4d-8639-40ae-9b5a-b4acf8e7b7cf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:55.157163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 164/329] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:54 2022] GET /identity/v3/users/28320a67b6cb4b7a87562e03a2d68f11 => generated 293 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:55.163320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0e54d-441a-4dbf-b2e7-1f7b78e1c432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:55.166116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bb4d-8639-40ae-9b5a-b4acf8e7b7cf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3fc0e54d-441a-4dbf-b2e7-1f7b78e1c432 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:55.180607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:55.182321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:55.183727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:55.189509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 166/330] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 14:59:55.192528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0e54d-441a-4dbf-b2e7-1f7b78e1c432 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:55.236465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:55.373607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bb4d-8639-40ae-9b5a-b4acf8e7b7cf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:55.462468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eefe8-dfb3-40b1-a59c-c2f4d57fcc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:55.463362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eefe8-dfb3-40b1-a59c-c2f4d57fcc0c None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:55.463697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eefe8-dfb3-40b1-a59c-c2f4d57fcc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:55.463937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eefe8-dfb3-40b1-a59c-c2f4d57fcc0c None admin] PATH_INFO: `/v3/system/users/28320a67b6cb4b7a87562e03a2d68f11/roles/8ac3052831b845bc88d5e829f84cb382` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:55.466213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370eefe8-dfb3-40b1-a59c-c2f4d57fcc0c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=28320a67b6cb4b7a87562e03a2d68f11, role_id=8ac3052831b845bc88d5e829f84cb382)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:55.468275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370eefe8-dfb3-40b1-a59c-c2f4d57fcc0c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:55.470033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0e54d-441a-4dbf-b2e7-1f7b78e1c432 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:55.480678 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 165/331] 10.222.0.90 () {58 vars in 1334 bytes} [Tue Jun 21 14:59:55 2022] PUT /identity/v3/system/users/28320a67b6cb4b7a87562e03a2d68f11/roles/8ac3052831b845bc88d5e829f84cb382 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 14:59:55.540761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fe35a-7817-42db-96b5-29cb1715bf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:55.541839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe35a-7817-42db-96b5-29cb1715bf99 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:55.542320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe35a-7817-42db-96b5-29cb1715bf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:55.542772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe35a-7817-42db-96b5-29cb1715bf99 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:55.543758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fe35a-7817-42db-96b5-29cb1715bf99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:55.544524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fe35a-7817-42db-96b5-29cb1715bf99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:55.546540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fe35a-7817-42db-96b5-29cb1715bf99 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:55.562526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 167/332] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 14:59:55.567772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eefe8-dfb3-40b1-a59c-c2f4d57fcc0c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:55.721884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:55.726239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eefe8-dfb3-40b1-a59c-c2f4d57fcc0c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:55.768779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c62b4-e8e6-4e0e-a680-2c8b09fa8d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:55.769691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c62b4-e8e6-4e0e-a680-2c8b09fa8d1f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:55.769982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c62b4-e8e6-4e0e-a680-2c8b09fa8d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:55.770262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c62b4-e8e6-4e0e-a680-2c8b09fa8d1f None admin] PATH_INFO: `/v3/users/c54f098f119f48f2b5d7ed3f1e024ae3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:55.771555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c62b4-e8e6-4e0e-a680-2c8b09fa8d1f None admin] RBAC: Authorizing `identity:get_user(user_id=c54f098f119f48f2b5d7ed3f1e024ae3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:55.773061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c62b4-e8e6-4e0e-a680-2c8b09fa8d1f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:55.778352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 166/333] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 14:59:55 2022] GET /identity/v3/users/c54f098f119f48f2b5d7ed3f1e024ae3 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:55.786519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fe35a-7817-42db-96b5-29cb1715bf99 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:55.884874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:55.950634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fe35a-7817-42db-96b5-29cb1715bf99 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:56.000873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57345c3-9ced-48af-a8d1-547989a6991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:56.001453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57345c3-9ced-48af-a8d1-547989a6991f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:56.001782 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57345c3-9ced-48af-a8d1-547989a6991f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:56.002037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57345c3-9ced-48af-a8d1-547989a6991f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:56.002879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57345c3-9ced-48af-a8d1-547989a6991f None admin] RBAC: Adding query filter params (role.id=fefbf89e7cb947a4a9651f4554c49df8, user.id=c54f098f119f48f2b5d7ed3f1e024ae3, scope.system=all) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:56.003201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57345c3-9ced-48af-a8d1-547989a6991f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:56.004666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57345c3-9ced-48af-a8d1-547989a6991f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:56.019703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 168/334] 10.222.0.90 () {56 vars in 1308 bytes} [Tue Jun 21 14:59:55 2022] GET /identity/v3/role_assignments?user.id=c54f098f119f48f2b5d7ed3f1e024ae3&scope.system=all&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:57.978377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac9b7-1eb5-4f27-9ba4-25077ec69b99 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:57.978377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac9b7-1eb5-4f27-9ba4-25077ec69b99 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:57.978377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac9b7-1eb5-4f27-9ba4-25077ec69b99 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:57.978377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 167/335] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:57.995750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2253-14a0-4816-b62c-9f8e449e0b6f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:57.996682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2253-14a0-4816-b62c-9f8e449e0b6f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:57.997209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d2253-14a0-4816-b62c-9f8e449e0b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:58.023965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-188d2253-14a0-4816-b62c-9f8e449e0b6f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:58.025491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-188d2253-14a0-4816-b62c-9f8e449e0b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:58.109418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 169/336] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:58.139325 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac9b7-1eb5-4f27-9ba4-25077ec69b99 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:58.272113 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756da997-0520-49ff-a0a6-f51d13c5d460 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:58.272698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756da997-0520-49ff-a0a6-f51d13c5d460 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:58.272933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756da997-0520-49ff-a0a6-f51d13c5d460 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:58.280674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 170/337] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:58.287328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac9b7-1eb5-4f27-9ba4-25077ec69b99 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:58.289821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b59745-ce99-46ed-b2cc-5cca65dbb13a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:58.291866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b59745-ce99-46ed-b2cc-5cca65dbb13a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:58.292762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b59745-ce99-46ed-b2cc-5cca65dbb13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:58.322391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f0b59745-ce99-46ed-b2cc-5cca65dbb13a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:58.324393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0b59745-ce99-46ed-b2cc-5cca65dbb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:58.374126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b33a0-ad32-46f6-ade9-22218425aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:58.375676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b33a0-ad32-46f6-ade9-22218425aab0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:58.376173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b33a0-ad32-46f6-ade9-22218425aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:58.376667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b33a0-ad32-46f6-ade9-22218425aab0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:58.390720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b33a0-ad32-46f6-ade9-22218425aab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:58.399533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-898b33a0-ad32-46f6-ade9-22218425aab0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:58.401776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:58.402789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 14:59:58.403679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 14:59:58.407874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 168/338] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 14:59:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:58.409439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962d616-5406-4d2b-8b20-6d03283ccc93 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:58.410176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962d616-5406-4d2b-8b20-6d03283ccc93 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:58.410687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962d616-5406-4d2b-8b20-6d03283ccc93 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:58.415764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 169/339] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:58.416809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962d616-5406-4d2b-8b20-6d03283ccc93 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:58.467898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 171/340] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:58.471124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:58.471472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a65512-dafc-411e-974f-8e2af2caf1a2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:58.471472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a65512-dafc-411e-974f-8e2af2caf1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:58.471472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a65512-dafc-411e-974f-8e2af2caf1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:58.519068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-56a65512-dafc-411e-974f-8e2af2caf1a2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:58.520877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-56a65512-dafc-411e-974f-8e2af2caf1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:58.604134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962d616-5406-4d2b-8b20-6d03283ccc93 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:58.692503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea1e5c-830f-41c2-8afd-617f13690ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:58.694247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea1e5c-830f-41c2-8afd-617f13690ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:58.694916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea1e5c-830f-41c2-8afd-617f13690ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:58.696647 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea1e5c-830f-41c2-8afd-617f13690ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:58.698632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea1e5c-830f-41c2-8afd-617f13690ac1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:58.699181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea1e5c-830f-41c2-8afd-617f13690ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:58.700731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 172/341] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:58.703319 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea1e5c-830f-41c2-8afd-617f13690ac1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:58.704645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a65512-dafc-411e-974f-8e2af2caf1a2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:58.736344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 170/342] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 14:59:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:58.740607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea1e5c-830f-41c2-8afd-617f13690ac1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:58.960957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:58.965621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a65512-dafc-411e-974f-8e2af2caf1a2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:58.985954 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:58.994116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea1e5c-830f-41c2-8afd-617f13690ac1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:59.014374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58972d-a401-4dc3-86c7-40369e09daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:59.015381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58972d-a401-4dc3-86c7-40369e09daaa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.015815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58972d-a401-4dc3-86c7-40369e09daaa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.016101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58972d-a401-4dc3-86c7-40369e09daaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.041429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58972d-a401-4dc3-86c7-40369e09daaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-df58972d-a401-4dc3-86c7-40369e09daaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:59.054770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:59.055775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:59.056608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:59.057244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 173/343] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:59.057867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58972d-a401-4dc3-86c7-40369e09daaa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:59.067834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3735fc-768b-45c2-9813-aa21e2fe3476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:59.068495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3735fc-768b-45c2-9813-aa21e2fe3476 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.068776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3735fc-768b-45c2-9813-aa21e2fe3476 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.069047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3735fc-768b-45c2-9813-aa21e2fe3476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.175519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3735fc-768b-45c2-9813-aa21e2fe3476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:59.177350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3735fc-768b-45c2-9813-aa21e2fe3476 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:59.218738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58972d-a401-4dc3-86c7-40369e09daaa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:59.263200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27a211-dc4a-4992-aa05-dcae82238ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:59.264139 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27a211-dc4a-4992-aa05-dcae82238ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.264610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27a211-dc4a-4992-aa05-dcae82238ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.265029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27a211-dc4a-4992-aa05-dcae82238ab9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.288942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27a211-dc4a-4992-aa05-dcae82238ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1e27a211-dc4a-4992-aa05-dcae82238ab9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 14:59:59.298577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 14:59:59.299783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 174/344] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 14:59:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 14:59:59.300641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27a211-dc4a-4992-aa05-dcae82238ab9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:59.313036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:59.334964 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 171/345] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 14:59:59.336943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b012e7-eb62-44c6-ae40-1bb722b0c249 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.337289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b012e7-eb62-44c6-ae40-1bb722b0c249 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.337929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b012e7-eb62-44c6-ae40-1bb722b0c249 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.339269 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 172/346] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:59.340401 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93556479-bf46-4cc6-b350-9f66f833a6d2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.340684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93556479-bf46-4cc6-b350-9f66f833a6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.341049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93556479-bf46-4cc6-b350-9f66f833a6d2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.342982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 173/347] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:59.344125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565ab94-3791-451d-8333-afdb35379af3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.344411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565ab94-3791-451d-8333-afdb35379af3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.344689 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565ab94-3791-451d-8333-afdb35379af3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.346140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 174/348] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 14:59:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 14:59:59.346250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:59.346714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565ab94-3791-451d-8333-afdb35379af3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:59.455943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27a211-dc4a-4992-aa05-dcae82238ab9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:59.496231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565ab94-3791-451d-8333-afdb35379af3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:59.504675 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289f8b0-cc26-4c56-9962-dc18878385e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:59.505819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289f8b0-cc26-4c56-9962-dc18878385e5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.505819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289f8b0-cc26-4c56-9962-dc18878385e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.506617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289f8b0-cc26-4c56-9962-dc18878385e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.508216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289f8b0-cc26-4c56-9962-dc18878385e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:59.508216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289f8b0-cc26-4c56-9962-dc18878385e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:59.509672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289f8b0-cc26-4c56-9962-dc18878385e5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:59.521372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 175/349] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:59.522403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289f8b0-cc26-4c56-9962-dc18878385e5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:59.542874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cb966-2809-4ac0-9b1b-4b512c8e86d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:59.543628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cb966-2809-4ac0-9b1b-4b512c8e86d9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.543870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cb966-2809-4ac0-9b1b-4b512c8e86d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.544408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cb966-2809-4ac0-9b1b-4b512c8e86d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.546517 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cb966-2809-4ac0-9b1b-4b512c8e86d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 14:59:59.549441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cb966-2809-4ac0-9b1b-4b512c8e86d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:59.549441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cb966-2809-4ac0-9b1b-4b512c8e86d9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:59.558730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 175/350] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 14:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:59.559846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83844f50-2550-4fae-a9ad-47e2d9848aec None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.560145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83844f50-2550-4fae-a9ad-47e2d9848aec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.560427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83844f50-2550-4fae-a9ad-47e2d9848aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.584481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-83844f50-2550-4fae-a9ad-47e2d9848aec None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:59.585939 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83844f50-2550-4fae-a9ad-47e2d9848aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:59.648463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:59.664239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 14:59:59.677975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289f8b0-cc26-4c56-9962-dc18878385e5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 14:59:59.684266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 176/351] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:59.686416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766db34f-333c-45ea-b71f-46e185bf9bb7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.686807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766db34f-333c-45ea-b71f-46e185bf9bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.687156 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766db34f-333c-45ea-b71f-46e185bf9bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.724198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-766db34f-333c-45ea-b71f-46e185bf9bb7 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:59.735217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-766db34f-333c-45ea-b71f-46e185bf9bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:59.742523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431f9b6-0ef7-4e9b-b4eb-316a149acf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 14:59:59.743676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f9b6-0ef7-4e9b-b4eb-316a149acf31 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.744430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f9b6-0ef7-4e9b-b4eb-316a149acf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.744430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f9b6-0ef7-4e9b-b4eb-316a149acf31 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.747595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431f9b6-0ef7-4e9b-b4eb-316a149acf31 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 14:59:59.750744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431f9b6-0ef7-4e9b-b4eb-316a149acf31 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 14:59:59.753730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 176/352] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 14:59:59 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 14:59:59.756058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3caac-f469-4f63-820a-738eb9cb67c1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 14:59:59.756058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3caac-f469-4f63-820a-738eb9cb67c1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 14:59:59.756058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3caac-f469-4f63-820a-738eb9cb67c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 14:59:59.781964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d1d3caac-f469-4f63-820a-738eb9cb67c1 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 14:59:59.783940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d1d3caac-f469-4f63-820a-738eb9cb67c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 14:59:59.833866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 177/353] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:59.842482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766db34f-333c-45ea-b71f-46e185bf9bb7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:59.893977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 177/354] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 14:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 14:59:59.895186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3caac-f469-4f63-820a-738eb9cb67c1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 14:59:59.992166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766db34f-333c-45ea-b71f-46e185bf9bb7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:00.005089 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:00.031056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:00.050118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3caac-f469-4f63-820a-738eb9cb67c1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:00.054662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca81bd0-a5c0-4ade-bccb-c56630f9d30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:00.055393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca81bd0-a5c0-4ade-bccb-c56630f9d30a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:00.055687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca81bd0-a5c0-4ade-bccb-c56630f9d30a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:00.055971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca81bd0-a5c0-4ade-bccb-c56630f9d30a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:00.094644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d106cb2-3c8e-45b9-8992-822a8a84eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:00.095309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d106cb2-3c8e-45b9-8992-822a8a84eaac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:00.095596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d106cb2-3c8e-45b9-8992-822a8a84eaac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:00.095875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d106cb2-3c8e-45b9-8992-822a8a84eaac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:00.162378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca81bd0-a5c0-4ade-bccb-c56630f9d30a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:00.163880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca81bd0-a5c0-4ade-bccb-c56630f9d30a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:00.184664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d106cb2-3c8e-45b9-8992-822a8a84eaac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:00.186524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d106cb2-3c8e-45b9-8992-822a8a84eaac None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:00.296303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 178/355] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:00.296518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca81bd0-a5c0-4ade-bccb-c56630f9d30a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:00.305669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:00.306149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:00.332390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 178/356] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 14:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:00.333371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d106cb2-3c8e-45b9-8992-822a8a84eaac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:00.442787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca81bd0-a5c0-4ade-bccb-c56630f9d30a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:00.479684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d106cb2-3c8e-45b9-8992-822a8a84eaac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:00.491013 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bbebe-ae30-4c47-8e66-d0928c792bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:00.491830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bbebe-ae30-4c47-8e66-d0928c792bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:00.492115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bbebe-ae30-4c47-8e66-d0928c792bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:00.492393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bbebe-ae30-4c47-8e66-d0928c792bd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:00.507848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bbebe-ae30-4c47-8e66-d0928c792bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d00bbebe-ae30-4c47-8e66-d0928c792bd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:00.520781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:00.521971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 179/357] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:00:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:00.523132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bbebe-ae30-4c47-8e66-d0928c792bd3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:00.534335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17a527-722f-4c33-a421-5fa362cf9ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:00.535309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17a527-722f-4c33-a421-5fa362cf9ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:00.535821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17a527-722f-4c33-a421-5fa362cf9ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:00.535909 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17a527-722f-4c33-a421-5fa362cf9ac7 None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:00.552140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17a527-722f-4c33-a421-5fa362cf9ac7 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:00.553639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17a527-722f-4c33-a421-5fa362cf9ac7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:00.555668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 179/358] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:00 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:00.556460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17a527-722f-4c33-a421-5fa362cf9ac7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:00.621195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:00.629069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:00.666918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bbebe-ae30-4c47-8e66-d0928c792bd3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:00.684565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17a527-722f-4c33-a421-5fa362cf9ac7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:00.704944 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70696bb4-bf72-40df-bffa-dd20ad709496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:00.705949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70696bb4-bf72-40df-bffa-dd20ad709496 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:00.706255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70696bb4-bf72-40df-bffa-dd20ad709496 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:00.706848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70696bb4-bf72-40df-bffa-dd20ad709496 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:00.718960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70696bb4-bf72-40df-bffa-dd20ad709496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:00.725048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c8b81-3621-4f24-b241-08d6be5627a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:00.725864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c8b81-3621-4f24-b241-08d6be5627a3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:00.726150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c8b81-3621-4f24-b241-08d6be5627a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:00.726434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c8b81-3621-4f24-b241-08d6be5627a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-70696bb4-bf72-40df-bffa-dd20ad709496 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:00.727850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:00.728893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:00.729872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 180/359] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:00.730814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70696bb4-bf72-40df-bffa-dd20ad709496 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:00.740657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c8b81-3621-4f24-b241-08d6be5627a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e48c8b81-3621-4f24-b241-08d6be5627a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:00.749808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:00.750977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 180/360] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:00.751821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c8b81-3621-4f24-b241-08d6be5627a3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:00.845682 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70696bb4-bf72-40df-bffa-dd20ad709496 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:00.866413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c8b81-3621-4f24-b241-08d6be5627a3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:00.873461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:00.879638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:00.883696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a259a-28fb-444b-bbba-e3b8b09bac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:00.884582 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a259a-28fb-444b-bbba-e3b8b09bac12 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:00.884873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a259a-28fb-444b-bbba-e3b8b09bac12 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:00.885224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a259a-28fb-444b-bbba-e3b8b09bac12 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:00.886445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a259a-28fb-444b-bbba-e3b8b09bac12 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:00.887949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a259a-28fb-444b-bbba-e3b8b09bac12 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:00.890459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 181/361] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:00 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:00.891311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a259a-28fb-444b-bbba-e3b8b09bac12 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:00.909942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa0700-9a7e-4b38-ab72-49c29fc5f103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:00.910815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa0700-9a7e-4b38-ab72-49c29fc5f103 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:00.911100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa0700-9a7e-4b38-ab72-49c29fc5f103 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:00.911380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa0700-9a7e-4b38-ab72-49c29fc5f103 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:00.912580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa0700-9a7e-4b38-ab72-49c29fc5f103 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:00.914075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa0700-9a7e-4b38-ab72-49c29fc5f103 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:00.915777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 181/362] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:00 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:00.919568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa0700-9a7e-4b38-ab72-49c29fc5f103 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:01.006984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a259a-28fb-444b-bbba-e3b8b09bac12 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:01.036373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa0700-9a7e-4b38-ab72-49c29fc5f103 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:01.048324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba76b-08b1-4e2f-87cb-5430ec69c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:01.048997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba76b-08b1-4e2f-87cb-5430ec69c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:01.049280 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba76b-08b1-4e2f-87cb-5430ec69c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:01.049598 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba76b-08b1-4e2f-87cb-5430ec69c6f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:01.050456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ba76b-08b1-4e2f-87cb-5430ec69c6f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:01.050945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ba76b-08b1-4e2f-87cb-5430ec69c6f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:01.052359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ba76b-08b1-4e2f-87cb-5430ec69c6f9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:01.060975 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 182/363] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:01.061897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba76b-08b1-4e2f-87cb-5430ec69c6f9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:01.076695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7bae6-eac4-4b3c-b7d9-865ae508ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:01.077788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7bae6-eac4-4b3c-b7d9-865ae508ad76 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:01.078112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7bae6-eac4-4b3c-b7d9-865ae508ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:01.078389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7bae6-eac4-4b3c-b7d9-865ae508ad76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:01.079274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7bae6-eac4-4b3c-b7d9-865ae508ad76 None admin] RBAC: Adding query filter params (group.id=5eb869bfc0144505991ad0f131b255f4, role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=b2ac89cfedcc4836b5603444826c7753) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:01.079587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7bae6-eac4-4b3c-b7d9-865ae508ad76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:01.081025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7bae6-eac4-4b3c-b7d9-865ae508ad76 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:01.087023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 182/364] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:00 2022] GET /identity/v3/role_assignments?group.id=5eb869bfc0144505991ad0f131b255f4&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:01.087812 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7bae6-eac4-4b3c-b7d9-865ae508ad76 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:01.139400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:01.159898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:01.209731 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba76b-08b1-4e2f-87cb-5430ec69c6f9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:01.239202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7bae6-eac4-4b3c-b7d9-865ae508ad76 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:01.252695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231f8b0-ec00-4b8c-a666-25ee652ed4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:01.253947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f8b0-ec00-4b8c-a666-25ee652ed4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:01.253947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f8b0-ec00-4b8c-a666-25ee652ed4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:01.253947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f8b0-ec00-4b8c-a666-25ee652ed4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:01.255705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231f8b0-ec00-4b8c-a666-25ee652ed4d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:01.255705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231f8b0-ec00-4b8c-a666-25ee652ed4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:01.256638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231f8b0-ec00-4b8c-a666-25ee652ed4d0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:01.266355 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 183/365] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:01.267337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231f8b0-ec00-4b8c-a666-25ee652ed4d0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:01.293627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f42e6-9a24-459e-b78d-5bf42c9e4122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:01.294589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f42e6-9a24-459e-b78d-5bf42c9e4122 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:01.295198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f42e6-9a24-459e-b78d-5bf42c9e4122 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:01.295451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f42e6-9a24-459e-b78d-5bf42c9e4122 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:01.296636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f42e6-9a24-459e-b78d-5bf42c9e4122 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:01.296636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f42e6-9a24-459e-b78d-5bf42c9e4122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:01.298164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f42e6-9a24-459e-b78d-5bf42c9e4122 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:01.308996 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 183/366] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 15:00:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:01.309894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f42e6-9a24-459e-b78d-5bf42c9e4122 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:01.393996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231f8b0-ec00-4b8c-a666-25ee652ed4d0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:01.417033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:01.438060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f42e6-9a24-459e-b78d-5bf42c9e4122 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:01.440004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421631-7b69-465b-a7b8-38999d3a17bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:01.440925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421631-7b69-465b-a7b8-38999d3a17bb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:01.441205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421631-7b69-465b-a7b8-38999d3a17bb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:01.441548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421631-7b69-465b-a7b8-38999d3a17bb None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:01.442784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36421631-7b69-465b-a7b8-38999d3a17bb None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:01.444223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36421631-7b69-465b-a7b8-38999d3a17bb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:01.446617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:01.452026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 184/367] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:01 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:01.452761 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421631-7b69-465b-a7b8-38999d3a17bb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:01.480748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbede-4d4a-4e2b-b64b-f7672a748c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:01.482099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbede-4d4a-4e2b-b64b-f7672a748c3a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:01.482099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbede-4d4a-4e2b-b64b-f7672a748c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:01.484350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbede-4d4a-4e2b-b64b-f7672a748c3a None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:01.485230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dbede-4d4a-4e2b-b64b-f7672a748c3a None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:01.486784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dbede-4d4a-4e2b-b64b-f7672a748c3a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:01.488503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 184/368] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:01 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:01.488503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbede-4d4a-4e2b-b64b-f7672a748c3a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:01.572749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421631-7b69-465b-a7b8-38999d3a17bb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:01.611102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbede-4d4a-4e2b-b64b-f7672a748c3a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:01.611574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767522a4-939d-442d-aad8-50422e31e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:01.612233 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767522a4-939d-442d-aad8-50422e31e18a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:01.612638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767522a4-939d-442d-aad8-50422e31e18a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:01.612802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767522a4-939d-442d-aad8-50422e31e18a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:01.657342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7a02c-ed93-4d15-bcc2-32c2224725ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:01.657975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7a02c-ed93-4d15-bcc2-32c2224725ee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:01.658251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7a02c-ed93-4d15-bcc2-32c2224725ee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:01.658530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7a02c-ed93-4d15-bcc2-32c2224725ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:01.682065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:01.698478 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767522a4-939d-442d-aad8-50422e31e18a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:01.699928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767522a4-939d-442d-aad8-50422e31e18a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:01.712584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:01.759401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7a02c-ed93-4d15-bcc2-32c2224725ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:01.760969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7a02c-ed93-4d15-bcc2-32c2224725ee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:01.824937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 185/369] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:01.824937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767522a4-939d-442d-aad8-50422e31e18a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:01.894950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 185/370] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:01.894950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7a02c-ed93-4d15-bcc2-32c2224725ee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:01.928951 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:01.946479 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767522a4-939d-442d-aad8-50422e31e18a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:01.991231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e9ad3-1e81-4de2-9d77-e74468d57537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:01.992113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e9ad3-1e81-4de2-9d77-e74468d57537 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:01.992395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e9ad3-1e81-4de2-9d77-e74468d57537 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:01.992675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e9ad3-1e81-4de2-9d77-e74468d57537 None admin] PATH_INFO: `/v3/users/28320a67b6cb4b7a87562e03a2d68f11` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:01.993117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:01.994099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e9ad3-1e81-4de2-9d77-e74468d57537 None admin] RBAC: Authorizing `identity:get_user(user_id=28320a67b6cb4b7a87562e03a2d68f11)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:01.995994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e9ad3-1e81-4de2-9d77-e74468d57537 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:01.998314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 186/371] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:00:01 2022] GET /identity/v3/users/28320a67b6cb4b7a87562e03a2d68f11 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:01.999984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e9ad3-1e81-4de2-9d77-e74468d57537 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:02.036343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7a02c-ed93-4d15-bcc2-32c2224725ee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:02.082791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89376a33-c4a4-4277-b2db-47a40e4f53f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:02.083608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89376a33-c4a4-4277-b2db-47a40e4f53f5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:02.083848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89376a33-c4a4-4277-b2db-47a40e4f53f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:02.084085 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89376a33-c4a4-4277-b2db-47a40e4f53f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:02.084994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89376a33-c4a4-4277-b2db-47a40e4f53f5 None admin] RBAC: Adding query filter params (group.id=5eb869bfc0144505991ad0f131b255f4, role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=b2ac89cfedcc4836b5603444826c7753) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:02.085304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89376a33-c4a4-4277-b2db-47a40e4f53f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:02.086772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89376a33-c4a4-4277-b2db-47a40e4f53f5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:02.105503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 186/372] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:01 2022] GET /identity/v3/role_assignments?group.id=5eb869bfc0144505991ad0f131b255f4&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:02.105503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89376a33-c4a4-4277-b2db-47a40e4f53f5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:02.134909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e9ad3-1e81-4de2-9d77-e74468d57537 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:02.197585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9f1bd-f888-4069-825e-4f99d1c106fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:02.198178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9f1bd-f888-4069-825e-4f99d1c106fd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:02.198460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9f1bd-f888-4069-825e-4f99d1c106fd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:02.199439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9f1bd-f888-4069-825e-4f99d1c106fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:02.200335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9f1bd-f888-4069-825e-4f99d1c106fd None admin] RBAC: Adding query filter params (group.id=5eb869bfc0144505991ad0f131b255f4, role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=6792456cc69f4d958161cf85839a9443) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:02.200650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9f1bd-f888-4069-825e-4f99d1c106fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:02.202675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9f1bd-f888-4069-825e-4f99d1c106fd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:02.210954 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 187/373] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:01 2022] GET /identity/v3/role_assignments?group.id=5eb869bfc0144505991ad0f131b255f4&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:02.211860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9f1bd-f888-4069-825e-4f99d1c106fd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:02.242886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:02.282499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89376a33-c4a4-4277-b2db-47a40e4f53f5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:02.330077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1764f-a808-4419-acd2-c0ae41abf8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:02.331125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1764f-a808-4419-acd2-c0ae41abf8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:02.331876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1764f-a808-4419-acd2-c0ae41abf8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:02.331876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1764f-a808-4419-acd2-c0ae41abf8d2 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:02.333393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1764f-a808-4419-acd2-c0ae41abf8d2 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:02.334979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1764f-a808-4419-acd2-c0ae41abf8d2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:02.337047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 187/374] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:02 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:02.337977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1764f-a808-4419-acd2-c0ae41abf8d2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:02.350129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:02.365632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9f1bd-f888-4069-825e-4f99d1c106fd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:02.418448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44ad01-c9d8-4acc-a7ae-a03d2230e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:02.420694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ad01-c9d8-4acc-a7ae-a03d2230e3ca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:02.421200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ad01-c9d8-4acc-a7ae-a03d2230e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:02.421920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44ad01-c9d8-4acc-a7ae-a03d2230e3ca None admin] PATH_INFO: `/v3/projects/48272287173249c5b6cf381e320026f5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:02.423680 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44ad01-c9d8-4acc-a7ae-a03d2230e3ca None admin] RBAC: Authorizing `identity:get_project(project_id=48272287173249c5b6cf381e320026f5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:02.425637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44ad01-c9d8-4acc-a7ae-a03d2230e3ca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:02.428179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 188/375] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:02 2022] GET /identity/v3/projects/48272287173249c5b6cf381e320026f5 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:02.429307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44ad01-c9d8-4acc-a7ae-a03d2230e3ca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:02.488107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1764f-a808-4419-acd2-c0ae41abf8d2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:02.551915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757acbe-99cb-4222-83a7-9b48b5cd38a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:02.552618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757acbe-99cb-4222-83a7-9b48b5cd38a7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:02.552904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757acbe-99cb-4222-83a7-9b48b5cd38a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:02.553183 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757acbe-99cb-4222-83a7-9b48b5cd38a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:02.554425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757acbe-99cb-4222-83a7-9b48b5cd38a7 None admin] RBAC: Adding query filter params (role.id=8ac3052831b845bc88d5e829f84cb382, user.id=28320a67b6cb4b7a87562e03a2d68f11, scope.system=all) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:02.555015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757acbe-99cb-4222-83a7-9b48b5cd38a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:02.556489 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757acbe-99cb-4222-83a7-9b48b5cd38a7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:02.562123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:02.572801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 188/376] 10.222.0.90 () {56 vars in 1308 bytes} [Tue Jun 21 15:00:02 2022] GET /identity/v3/role_assignments?user.id=28320a67b6cb4b7a87562e03a2d68f11&scope.system=all&role.id=8ac3052831b845bc88d5e829f84cb382 => generated 510 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:02.574171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757acbe-99cb-4222-83a7-9b48b5cd38a7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:02.582419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44ad01-c9d8-4acc-a7ae-a03d2230e3ca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:02.644839 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2a294-a85f-46f9-92f5-b3bddda0b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:02.646185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2a294-a85f-46f9-92f5-b3bddda0b468 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:02.646670 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2a294-a85f-46f9-92f5-b3bddda0b468 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:02.647141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2a294-a85f-46f9-92f5-b3bddda0b468 None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:02.651219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2a294-a85f-46f9-92f5-b3bddda0b468 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:02.653282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2a294-a85f-46f9-92f5-b3bddda0b468 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:02.656085 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:02.657537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 189/377] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:02 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:02.662438 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2a294-a85f-46f9-92f5-b3bddda0b468 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:02.704033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757acbe-99cb-4222-83a7-9b48b5cd38a7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:02.751578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15095f63-b291-43f3-ac86-983cefb702f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:02.752926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15095f63-b291-43f3-ac86-983cefb702f1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:02.753205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15095f63-b291-43f3-ac86-983cefb702f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:02.753500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15095f63-b291-43f3-ac86-983cefb702f1 None admin] PATH_INFO: `/v3/groups/5ca2700c8b0048da804ec178bfc92c37` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:02.759503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15095f63-b291-43f3-ac86-983cefb702f1 None admin] RBAC: Authorizing `identity:get_group(group_id=5ca2700c8b0048da804ec178bfc92c37)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:02.761163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15095f63-b291-43f3-ac86-983cefb702f1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:02.763438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 189/378] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:02 2022] GET /identity/v3/groups/5ca2700c8b0048da804ec178bfc92c37 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:02.770593 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15095f63-b291-43f3-ac86-983cefb702f1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:02.890849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2a294-a85f-46f9-92f5-b3bddda0b468 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:02.960692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b5917-00ad-48dd-b898-2330fe820e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:02.961737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b5917-00ad-48dd-b898-2330fe820e0e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:02.962091 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b5917-00ad-48dd-b898-2330fe820e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:02.962442 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b5917-00ad-48dd-b898-2330fe820e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:02.963351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b5917-00ad-48dd-b898-2330fe820e0e None admin] RBAC: Adding query filter params (group.id=5eb869bfc0144505991ad0f131b255f4, role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=6792456cc69f4d958161cf85839a9443) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:02.963752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b5917-00ad-48dd-b898-2330fe820e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:02.964235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15095f63-b291-43f3-ac86-983cefb702f1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:02.965321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b5917-00ad-48dd-b898-2330fe820e0e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:02.977506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 190/379] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:02 2022] GET /identity/v3/role_assignments?group.id=5eb869bfc0144505991ad0f131b255f4&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 260 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:03.006568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:03.019193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de3371-bfe1-490a-939c-918736ad5769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:03.020205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de3371-bfe1-490a-939c-918736ad5769 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:03.020670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de3371-bfe1-490a-939c-918736ad5769 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:03.021127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de3371-bfe1-490a-939c-918736ad5769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:03.022246 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de3371-bfe1-490a-939c-918736ad5769 None admin] RBAC: Adding query filter params (group.id=5ca2700c8b0048da804ec178bfc92c37, role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=48272287173249c5b6cf381e320026f5) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:03.022759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de3371-bfe1-490a-939c-918736ad5769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:03.024406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de3371-bfe1-490a-939c-918736ad5769 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:03.032961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 190/380] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:02 2022] GET /identity/v3/role_assignments?group.id=5ca2700c8b0048da804ec178bfc92c37&scope.project.id=48272287173249c5b6cf381e320026f5&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:03.475007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9af8c-7123-4096-963f-93fcb0d3343a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:03.476184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9af8c-7123-4096-963f-93fcb0d3343a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:03.476671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9af8c-7123-4096-963f-93fcb0d3343a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:03.478551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 191/381] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:03.485513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04a1d-1514-4623-b69f-f266d2bd1c31 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:03.486412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04a1d-1514-4623-b69f-f266d2bd1c31 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:03.486897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04a1d-1514-4623-b69f-f266d2bd1c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:03.505659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ced04a1d-1514-4623-b69f-f266d2bd1c31 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:03.507204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ced04a1d-1514-4623-b69f-f266d2bd1c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:03.584805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 191/382] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:00:03.608141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9af8c-7123-4096-963f-93fcb0d3343a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:03.630587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:03.733212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9af8c-7123-4096-963f-93fcb0d3343a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:03.771117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768d54c-4cb7-449a-9916-1272ba63eb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:03.772342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768d54c-4cb7-449a-9916-1272ba63eb4f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:03.772823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768d54c-4cb7-449a-9916-1272ba63eb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:03.773291 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768d54c-4cb7-449a-9916-1272ba63eb4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:03.786047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768d54c-4cb7-449a-9916-1272ba63eb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9768d54c-4cb7-449a-9916-1272ba63eb4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:03.795907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:03.796856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:03.797777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:03.800539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 192/383] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:00:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:03.806824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04a1d-1514-4623-b69f-f266d2bd1c31 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:03.926902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04a1d-1514-4623-b69f-f266d2bd1c31 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:03.955409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:03.970761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0c5f9-37c2-4b4b-b0f9-cc610ae8b643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:03.971497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0c5f9-37c2-4b4b-b0f9-cc610ae8b643 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:03.971730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0c5f9-37c2-4b4b-b0f9-cc610ae8b643 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:03.972007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0c5f9-37c2-4b4b-b0f9-cc610ae8b643 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:03.972770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0c5f9-37c2-4b4b-b0f9-cc610ae8b643 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:03.973077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0c5f9-37c2-4b4b-b0f9-cc610ae8b643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:03.974575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0c5f9-37c2-4b4b-b0f9-cc610ae8b643 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:03.986336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 192/384] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:03.991666 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768d54c-4cb7-449a-9916-1272ba63eb4f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:04.081842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:04.106640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768d54c-4cb7-449a-9916-1272ba63eb4f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:04.145284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f559b3-db4c-4258-8179-198688ff98d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:04.146272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f559b3-db4c-4258-8179-198688ff98d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:04.146556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f559b3-db4c-4258-8179-198688ff98d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:04.146834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f559b3-db4c-4258-8179-198688ff98d8 None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:04.149793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f559b3-db4c-4258-8179-198688ff98d8 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:04.151342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f559b3-db4c-4258-8179-198688ff98d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:04.153406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 193/385] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:03 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:04.159304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0c5f9-37c2-4b4b-b0f9-cc610ae8b643 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:04.271980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0c5f9-37c2-4b4b-b0f9-cc610ae8b643 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:04.307944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e02f5-ff52-4328-acd7-c0f94962e319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:04.308811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e02f5-ff52-4328-acd7-c0f94962e319 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:04.309103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e02f5-ff52-4328-acd7-c0f94962e319 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:04.309386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e02f5-ff52-4328-acd7-c0f94962e319 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:04.313200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e02f5-ff52-4328-acd7-c0f94962e319 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:04.314754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e02f5-ff52-4328-acd7-c0f94962e319 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:04.316858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 193/386] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:04 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:04.322517 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f559b3-db4c-4258-8179-198688ff98d8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:04.436374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f559b3-db4c-4258-8179-198688ff98d8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:04.478512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374c46d-1099-4cb6-8b5b-686d87904035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:04.479437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374c46d-1099-4cb6-8b5b-686d87904035 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:04.479750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374c46d-1099-4cb6-8b5b-686d87904035 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:04.480064 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374c46d-1099-4cb6-8b5b-686d87904035 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753/groups/5eb869bfc0144505991ad0f131b255f4/roles/b1558d27591d4ee3b4070a19333d6180` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:04.482626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374c46d-1099-4cb6-8b5b-686d87904035 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2ac89cfedcc4836b5603444826c7753, group_id=5eb869bfc0144505991ad0f131b255f4, role_id=b1558d27591d4ee3b4070a19333d6180)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:04.484380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374c46d-1099-4cb6-8b5b-686d87904035 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:04.507907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 194/387] 10.222.0.90 () {58 vars in 1442 bytes} [Tue Jun 21 15:00:04 2022] PUT /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753/groups/5eb869bfc0144505991ad0f131b255f4/roles/b1558d27591d4ee3b4070a19333d6180 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:00:05.274963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05bee3-86f2-4aee-ac4c-d3f4fb746b08 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:05.275924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05bee3-86f2-4aee-ac4c-d3f4fb746b08 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:05.276396 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05bee3-86f2-4aee-ac4c-d3f4fb746b08 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:05.278285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 194/388] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:00:05.284592 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0bb69-d655-4eac-b3ca-64ce1acf0171 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:05.285138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0bb69-d655-4eac-b3ca-64ce1acf0171 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:05.285672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0bb69-d655-4eac-b3ca-64ce1acf0171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:05.300084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:05.310260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-42a0bb69-d655-4eac-b3ca-64ce1acf0171 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:05.312029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-42a0bb69-d655-4eac-b3ca-64ce1acf0171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:05.358322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b453-004a-4909-a390-3b05415326f1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:05.358979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b453-004a-4909-a390-3b05415326f1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:05.359454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1b453-004a-4909-a390-3b05415326f1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:05.361026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 195/389] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:00:05.367410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a8204-df97-4e53-bfba-3f98bff04c83 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:05.367858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a8204-df97-4e53-bfba-3f98bff04c83 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:05.368295 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a8204-df97-4e53-bfba-3f98bff04c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:05.401042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-837a8204-df97-4e53-bfba-3f98bff04c83 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:05.402272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-837a8204-df97-4e53-bfba-3f98bff04c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:05.427417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 195/390] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:05.455925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0bb69-d655-4eac-b3ca-64ce1acf0171 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:05.522802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:05.575555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 196/391] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:05.606763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a8204-df97-4e53-bfba-3f98bff04c83 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:05.656507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0bb69-d655-4eac-b3ca-64ce1acf0171 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:05.769145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a8204-df97-4e53-bfba-3f98bff04c83 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:05.786294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ebd2d-c0bb-41f7-97d6-a97368c34db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:05.787182 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ebd2d-c0bb-41f7-97d6-a97368c34db7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:05.787494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ebd2d-c0bb-41f7-97d6-a97368c34db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:05.787793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ebd2d-c0bb-41f7-97d6-a97368c34db7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:05.804424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:05.810101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d0646-a7f3-4ecd-bca5-7de94fe7c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:05.811682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0646-a7f3-4ecd-bca5-7de94fe7c061 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:05.812116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0646-a7f3-4ecd-bca5-7de94fe7c061 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:05.812532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0646-a7f3-4ecd-bca5-7de94fe7c061 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:05.823880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d0646-a7f3-4ecd-bca5-7de94fe7c061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:05.832753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ebd2d-c0bb-41f7-97d6-a97368c34db7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-594d0646-a7f3-4ecd-bca5-7de94fe7c061 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:05.840719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:05.842137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:00:05.842967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:05.844899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 197/392] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-380ebd2d-c0bb-41f7-97d6-a97368c34db7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:05.849709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:05.850575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:00:05.851472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:05.853129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d0646-a7f3-4ecd-bca5-7de94fe7c061 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:05.864426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 196/393] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:05.870907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ebd2d-c0bb-41f7-97d6-a97368c34db7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:05.940895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:06.070410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d0646-a7f3-4ecd-bca5-7de94fe7c061 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:06.084889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ebd2d-c0bb-41f7-97d6-a97368c34db7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:06.125340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f04559-94fa-4f54-a87b-6921c8b60ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:06.126785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04559-94fa-4f54-a87b-6921c8b60ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.127235 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04559-94fa-4f54-a87b-6921c8b60ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.127664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f04559-94fa-4f54-a87b-6921c8b60ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.128578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f04559-94fa-4f54-a87b-6921c8b60ef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:06.129029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f04559-94fa-4f54-a87b-6921c8b60ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:06.130821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f04559-94fa-4f54-a87b-6921c8b60ef6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:06.141686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 197/394] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 15:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:06.143852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b0802-d935-4c5f-bc17-36a3027fd20f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.144566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b0802-d935-4c5f-bc17-36a3027fd20f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.145058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b0802-d935-4c5f-bc17-36a3027fd20f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.147028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 198/395] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:06.147923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b0802-d935-4c5f-bc17-36a3027fd20f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:06.150914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7b146-7fa3-4d28-9117-99ef468572dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:06.151890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b146-7fa3-4d28-9117-99ef468572dc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.152424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b146-7fa3-4d28-9117-99ef468572dc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.152925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b146-7fa3-4d28-9117-99ef468572dc None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.154573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7b146-7fa3-4d28-9117-99ef468572dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:06.155559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7b146-7fa3-4d28-9117-99ef468572dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:06.157574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7b146-7fa3-4d28-9117-99ef468572dc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:06.167363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 198/396] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 15:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:06.169401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18320-c923-4e96-89a5-97c8f7bd0df3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.170322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18320-c923-4e96-89a5-97c8f7bd0df3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.170821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18320-c923-4e96-89a5-97c8f7bd0df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.189427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c3e18320-c923-4e96-89a5-97c8f7bd0df3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:06.191184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3e18320-c923-4e96-89a5-97c8f7bd0df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:06.226693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:06.288176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 199/397] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:06.290006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18320-c923-4e96-89a5-97c8f7bd0df3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:06.312969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b0802-d935-4c5f-bc17-36a3027fd20f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:06.354012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:06.364991 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e796b-0553-49b5-a210-e2bf63e62ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:06.366292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e796b-0553-49b5-a210-e2bf63e62ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.366576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e796b-0553-49b5-a210-e2bf63e62ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.366997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e796b-0553-49b5-a210-e2bf63e62ac9 None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.368606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e796b-0553-49b5-a210-e2bf63e62ac9 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:06.370814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e796b-0553-49b5-a210-e2bf63e62ac9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:06.373675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 199/398] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:06 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:06.375218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e796b-0553-49b5-a210-e2bf63e62ac9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:06.421312 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18320-c923-4e96-89a5-97c8f7bd0df3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:06.463873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447101-c4d3-40f4-aff0-bc3361ce9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:06.465167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447101-c4d3-40f4-aff0-bc3361ce9745 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.465695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447101-c4d3-40f4-aff0-bc3361ce9745 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.466191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447101-c4d3-40f4-aff0-bc3361ce9745 None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.468987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48447101-c4d3-40f4-aff0-bc3361ce9745 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:06.470710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48447101-c4d3-40f4-aff0-bc3361ce9745 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:06.472938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 200/399] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:06 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:06.474184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447101-c4d3-40f4-aff0-bc3361ce9745 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:06.503947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e796b-0553-49b5-a210-e2bf63e62ac9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:06.534445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:06.545766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c364f-2b15-406a-8d14-238abca50f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:06.546583 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c364f-2b15-406a-8d14-238abca50f74 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.546875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c364f-2b15-406a-8d14-238abca50f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.547152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c364f-2b15-406a-8d14-238abca50f74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.559802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c364f-2b15-406a-8d14-238abca50f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4f5c364f-2b15-406a-8d14-238abca50f74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:06.575198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:06.576948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:06.578949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 200/400] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:00:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:06.581845 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c364f-2b15-406a-8d14-238abca50f74 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:06.606562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447101-c4d3-40f4-aff0-bc3361ce9745 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:06.609514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:06.648418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9544bc2-bee3-4fc3-a1d8-8df3df8b0d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:06.649309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9544bc2-bee3-4fc3-a1d8-8df3df8b0d07 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.649626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9544bc2-bee3-4fc3-a1d8-8df3df8b0d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.649918 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9544bc2-bee3-4fc3-a1d8-8df3df8b0d07 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.651099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9544bc2-bee3-4fc3-a1d8-8df3df8b0d07 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:06.652541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9544bc2-bee3-4fc3-a1d8-8df3df8b0d07 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:06.659106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 201/401] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:06 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:06.659106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c136a7-82d4-4093-8558-af67df3d7493 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.659106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c136a7-82d4-4093-8558-af67df3d7493 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.659106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c136a7-82d4-4093-8558-af67df3d7493 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.659106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 202/402] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:06.659106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c136a7-82d4-4093-8558-af67df3d7493 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:06.721308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c364f-2b15-406a-8d14-238abca50f74 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:06.770285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e84f6-4c7a-4679-94dd-09ddf1702e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:06.771210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e84f6-4c7a-4679-94dd-09ddf1702e48 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.771517 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e84f6-4c7a-4679-94dd-09ddf1702e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.771813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e84f6-4c7a-4679-94dd-09ddf1702e48 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.773064 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e84f6-4c7a-4679-94dd-09ddf1702e48 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:06.774672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e84f6-4c7a-4679-94dd-09ddf1702e48 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:06.776453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 201/403] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:06 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:06.777232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e84f6-4c7a-4679-94dd-09ddf1702e48 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:06.785368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c136a7-82d4-4093-8558-af67df3d7493 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:06.832274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b8d9a-57d5-4efa-a671-b4b13c4241ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:06.833271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8d9a-57d5-4efa-a671-b4b13c4241ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.833758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8d9a-57d5-4efa-a671-b4b13c4241ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.834236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b8d9a-57d5-4efa-a671-b4b13c4241ae None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.835028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b8d9a-57d5-4efa-a671-b4b13c4241ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:06.835295 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b8d9a-57d5-4efa-a671-b4b13c4241ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:06.836658 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b8d9a-57d5-4efa-a671-b4b13c4241ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:06.845644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:06.851549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 203/404] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:06.852844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3e7a-111b-49e5-9222-065b529dcc16 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.853131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3e7a-111b-49e5-9222-065b529dcc16 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.853457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3e7a-111b-49e5-9222-065b529dcc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.876426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-42bc3e7a-111b-49e5-9222-065b529dcc16 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:06.878261 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42bc3e7a-111b-49e5-9222-065b529dcc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:06.907234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e84f6-4c7a-4679-94dd-09ddf1702e48 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:06.913845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:06.958853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33f8ce-b27a-41f4-a7cf-631e036e8fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:06.959738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33f8ce-b27a-41f4-a7cf-631e036e8fec None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:06.960033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33f8ce-b27a-41f4-a7cf-631e036e8fec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:06.960300 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33f8ce-b27a-41f4-a7cf-631e036e8fec None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753/groups/5eb869bfc0144505991ad0f131b255f4/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:06.962360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33f8ce-b27a-41f4-a7cf-631e036e8fec None admin] RBAC: Authorizing `identity:create_grant(project_id=b2ac89cfedcc4836b5603444826c7753, group_id=5eb869bfc0144505991ad0f131b255f4, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:06.963821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33f8ce-b27a-41f4-a7cf-631e036e8fec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:06.972831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 204/405] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:06.974155 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc3e7a-111b-49e5-9222-065b529dcc16 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:06.988136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 202/406] 10.222.0.90 () {58 vars in 1442 bytes} [Tue Jun 21 15:00:06 2022] PUT /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753/groups/5eb869bfc0144505991ad0f131b255f4/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:06.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33f8ce-b27a-41f4-a7cf-631e036e8fec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:07.137801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc3e7a-111b-49e5-9222-065b529dcc16 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:07.188872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00cac-192f-4112-ad89-a711fc33bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:07.190286 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00cac-192f-4112-ad89-a711fc33bc06 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:07.190401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00cac-192f-4112-ad89-a711fc33bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:07.191286 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00cac-192f-4112-ad89-a711fc33bc06 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443/groups/5eb869bfc0144505991ad0f131b255f4/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:07.192903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00cac-192f-4112-ad89-a711fc33bc06 None admin] RBAC: Authorizing `identity:create_grant(project_id=6792456cc69f4d958161cf85839a9443, group_id=5eb869bfc0144505991ad0f131b255f4, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:07.194889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33f8ce-b27a-41f4-a7cf-631e036e8fec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:07.195022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00cac-192f-4112-ad89-a711fc33bc06 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:07.219411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 205/407] 10.222.0.90 () {58 vars in 1442 bytes} [Tue Jun 21 15:00:06 2022] PUT /identity/v3/projects/6792456cc69f4d958161cf85839a9443/groups/5eb869bfc0144505991ad0f131b255f4/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:07.220952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00cac-192f-4112-ad89-a711fc33bc06 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:07.241857 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:07.279203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:07.285432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b550d2-c403-434c-a6aa-2930435110fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:07.286889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b550d2-c403-434c-a6aa-2930435110fc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:07.287432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b550d2-c403-434c-a6aa-2930435110fc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:07.288577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b550d2-c403-434c-a6aa-2930435110fc None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:07.290386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b550d2-c403-434c-a6aa-2930435110fc None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:07.294269 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b550d2-c403-434c-a6aa-2930435110fc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:07.296790 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 203/408] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:06 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:07.298243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32942d-391b-4bca-b2c2-0c1e70d83c47 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:07.298531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32942d-391b-4bca-b2c2-0c1e70d83c47 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:07.298865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32942d-391b-4bca-b2c2-0c1e70d83c47 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:07.300340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 204/409] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:07.305584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32942d-391b-4bca-b2c2-0c1e70d83c47 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:07.417739 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00cac-192f-4112-ad89-a711fc33bc06 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:07.458353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32942d-391b-4bca-b2c2-0c1e70d83c47 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:07.467441 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55345abe-cab6-46ae-94ee-bdae1f507ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:07.468247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55345abe-cab6-46ae-94ee-bdae1f507ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:07.468534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55345abe-cab6-46ae-94ee-bdae1f507ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:07.468816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55345abe-cab6-46ae-94ee-bdae1f507ca6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:07.480710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55345abe-cab6-46ae-94ee-bdae1f507ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-55345abe-cab6-46ae-94ee-bdae1f507ca6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:07.491042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:07.492185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:07.494052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 206/410] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:07.495654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8ae2-b29a-45ce-8a50-5f59b9da7093 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:07.495654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8ae2-b29a-45ce-8a50-5f59b9da7093 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:07.495654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8ae2-b29a-45ce-8a50-5f59b9da7093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:07.501514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df047498-748e-4faa-95fa-04324ce9b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:07.502486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df047498-748e-4faa-95fa-04324ce9b787 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:07.502772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df047498-748e-4faa-95fa-04324ce9b787 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:07.503155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df047498-748e-4faa-95fa-04324ce9b787 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:07.504479 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df047498-748e-4faa-95fa-04324ce9b787 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:07.505941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df047498-748e-4faa-95fa-04324ce9b787 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:07.508077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 205/411] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:07 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:07.508859 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df047498-748e-4faa-95fa-04324ce9b787 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:07.518304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b1ea8ae2-b29a-45ce-8a50-5f59b9da7093 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:07.519816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1ea8ae2-b29a-45ce-8a50-5f59b9da7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:07.566367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:07.602982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 207/412] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:07.610740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8ae2-b29a-45ce-8a50-5f59b9da7093 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:07.643812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df047498-748e-4faa-95fa-04324ce9b787 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:07.644721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:07.704371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6da7-994b-4b64-bd9a-037caa00bc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:07.705512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6da7-994b-4b64-bd9a-037caa00bc7e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:07.705913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6da7-994b-4b64-bd9a-037caa00bc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:07.706346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6da7-994b-4b64-bd9a-037caa00bc7e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:07.708189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a6da7-994b-4b64-bd9a-037caa00bc7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:07.708735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a6da7-994b-4b64-bd9a-037caa00bc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:07.711265 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a6da7-994b-4b64-bd9a-037caa00bc7e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:07.722786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 206/413] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:07.724430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6da7-994b-4b64-bd9a-037caa00bc7e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:07.778715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8ae2-b29a-45ce-8a50-5f59b9da7093 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:07.838292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4535155-29bb-41d9-9ebf-3900f856ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:07.839711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4535155-29bb-41d9-9ebf-3900f856ea18 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:07.840235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4535155-29bb-41d9-9ebf-3900f856ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:07.840790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4535155-29bb-41d9-9ebf-3900f856ea18 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443/groups/5eb869bfc0144505991ad0f131b255f4/roles/b1558d27591d4ee3b4070a19333d6180` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:07.843898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4535155-29bb-41d9-9ebf-3900f856ea18 None admin] RBAC: Authorizing `identity:create_grant(project_id=6792456cc69f4d958161cf85839a9443, group_id=5eb869bfc0144505991ad0f131b255f4, role_id=b1558d27591d4ee3b4070a19333d6180)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:07.845964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4535155-29bb-41d9-9ebf-3900f856ea18 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:07.865168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 208/414] 10.222.0.90 () {58 vars in 1442 bytes} [Tue Jun 21 15:00:07 2022] PUT /identity/v3/projects/6792456cc69f4d958161cf85839a9443/groups/5eb869bfc0144505991ad0f131b255f4/roles/b1558d27591d4ee3b4070a19333d6180 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:07.867402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4535155-29bb-41d9-9ebf-3900f856ea18 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:07.869836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6da7-994b-4b64-bd9a-037caa00bc7e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:07.891476 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:07.956808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ca987-d7c8-4382-8718-8289b1e34467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:07.957701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ca987-d7c8-4382-8718-8289b1e34467 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:07.958024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ca987-d7c8-4382-8718-8289b1e34467 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:07.958342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ca987-d7c8-4382-8718-8289b1e34467 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:07.984719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ca987-d7c8-4382-8718-8289b1e34467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:07.995711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3f8ca987-d7c8-4382-8718-8289b1e34467 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:08.003830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:08.004861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:08.010320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 207/415] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:00:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:08.015427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ca987-d7c8-4382-8718-8289b1e34467 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:08.083899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4535155-29bb-41d9-9ebf-3900f856ea18 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:08.166242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986db8-ed39-48fe-9864-d99ac6170e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:08.168000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986db8-ed39-48fe-9864-d99ac6170e79 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:08.168000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986db8-ed39-48fe-9864-d99ac6170e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:08.168000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986db8-ed39-48fe-9864-d99ac6170e79 None admin] PATH_INFO: `/v3/groups/5ca2700c8b0048da804ec178bfc92c37` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:08.171521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986db8-ed39-48fe-9864-d99ac6170e79 None admin] RBAC: Authorizing `identity:get_group(group_id=5ca2700c8b0048da804ec178bfc92c37)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:08.173927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986db8-ed39-48fe-9864-d99ac6170e79 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:08.177701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 209/416] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:07 2022] GET /identity/v3/groups/5ca2700c8b0048da804ec178bfc92c37 => generated 229 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:08.184267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986db8-ed39-48fe-9864-d99ac6170e79 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:08.236319 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ca987-d7c8-4382-8718-8289b1e34467 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:08.335664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf9c0-7a67-42c2-8ad6-278714e2bbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:08.336931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf9c0-7a67-42c2-8ad6-278714e2bbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:08.339601 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf9c0-7a67-42c2-8ad6-278714e2bbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:08.340344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf9c0-7a67-42c2-8ad6-278714e2bbb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:08.342222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf9c0-7a67-42c2-8ad6-278714e2bbb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:08.346760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf9c0-7a67-42c2-8ad6-278714e2bbb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:08.348828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf9c0-7a67-42c2-8ad6-278714e2bbb6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:08.377407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 208/417] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:08.392656 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986db8-ed39-48fe-9864-d99ac6170e79 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:08.400321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf9c0-7a67-42c2-8ad6-278714e2bbb6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:08.483901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb3ae7-e504-411e-8129-4ad79f7a857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:08.487795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb3ae7-e504-411e-8129-4ad79f7a857f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:08.488770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb3ae7-e504-411e-8129-4ad79f7a857f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:08.489630 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb3ae7-e504-411e-8129-4ad79f7a857f None admin] PATH_INFO: `/v3/projects/48272287173249c5b6cf381e320026f5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:08.492814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb3ae7-e504-411e-8129-4ad79f7a857f None admin] RBAC: Authorizing `identity:get_project(project_id=48272287173249c5b6cf381e320026f5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:08.496142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb3ae7-e504-411e-8129-4ad79f7a857f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:08.500585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 210/418] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:08 2022] GET /identity/v3/projects/48272287173249c5b6cf381e320026f5 => generated 344 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:08.509625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb3ae7-e504-411e-8129-4ad79f7a857f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:08.532272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:08.593938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:08.688334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf9c0-7a67-42c2-8ad6-278714e2bbb6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:08.705594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb3ae7-e504-411e-8129-4ad79f7a857f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:08.739964 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600221a-9691-4221-b7bd-bf995012622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:08.740512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600221a-9691-4221-b7bd-bf995012622d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:08.740811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600221a-9691-4221-b7bd-bf995012622d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:08.741064 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600221a-9691-4221-b7bd-bf995012622d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:08.774188 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffae92c-b53e-4724-a96f-9ae9f5baed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:08.775150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffae92c-b53e-4724-a96f-9ae9f5baed15 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:08.775475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffae92c-b53e-4724-a96f-9ae9f5baed15 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:08.775795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffae92c-b53e-4724-a96f-9ae9f5baed15 None admin] PATH_INFO: `/v3/projects/48272287173249c5b6cf381e320026f5/groups/5ca2700c8b0048da804ec178bfc92c37/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:08.778014 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffae92c-b53e-4724-a96f-9ae9f5baed15 None admin] RBAC: Authorizing `identity:create_grant(project_id=48272287173249c5b6cf381e320026f5, group_id=5ca2700c8b0048da804ec178bfc92c37, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:08.780605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffae92c-b53e-4724-a96f-9ae9f5baed15 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:08.812147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 211/419] 10.222.0.90 () {58 vars in 1442 bytes} [Tue Jun 21 15:00:08 2022] PUT /identity/v3/projects/48272287173249c5b6cf381e320026f5/groups/5ca2700c8b0048da804ec178bfc92c37/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:08.883268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600221a-9691-4221-b7bd-bf995012622d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:08.884914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600221a-9691-4221-b7bd-bf995012622d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:08.960924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:09.058471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 209/420] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:09.064643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffae92c-b53e-4724-a96f-9ae9f5baed15 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:09.143928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:09.188018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffae92c-b53e-4724-a96f-9ae9f5baed15 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:09.225767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e40e3-579f-4b53-ab20-34819e1ea394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:09.227193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e40e3-579f-4b53-ab20-34819e1ea394 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:09.227704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e40e3-579f-4b53-ab20-34819e1ea394 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:09.228210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e40e3-579f-4b53-ab20-34819e1ea394 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:09.229714 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e40e3-579f-4b53-ab20-34819e1ea394 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:09.231466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e40e3-579f-4b53-ab20-34819e1ea394 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:09.234318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 212/421] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:09 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:09.239892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600221a-9691-4221-b7bd-bf995012622d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:09.377680 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600221a-9691-4221-b7bd-bf995012622d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:09.415307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9eebac-308e-4774-9753-036a1b1acbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:09.416172 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eebac-308e-4774-9753-036a1b1acbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:09.416458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eebac-308e-4774-9753-036a1b1acbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:09.416737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eebac-308e-4774-9753-036a1b1acbe9 None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:09.417955 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eebac-308e-4774-9753-036a1b1acbe9 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:09.419964 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eebac-308e-4774-9753-036a1b1acbe9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:09.421953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 210/422] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:09 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:09.431642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e40e3-579f-4b53-ab20-34819e1ea394 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:09.567817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e40e3-579f-4b53-ab20-34819e1ea394 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:09.621014 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665192a-6df6-49af-a94b-6c8f11dc0f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:09.621799 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665192a-6df6-49af-a94b-6c8f11dc0f3b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:09.622211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665192a-6df6-49af-a94b-6c8f11dc0f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:09.622799 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665192a-6df6-49af-a94b-6c8f11dc0f3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:09.624272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665192a-6df6-49af-a94b-6c8f11dc0f3b None admin] RBAC: Adding query filter params (group.id=5eb869bfc0144505991ad0f131b255f4, role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=b2ac89cfedcc4836b5603444826c7753) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:09.624752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665192a-6df6-49af-a94b-6c8f11dc0f3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:09.627118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665192a-6df6-49af-a94b-6c8f11dc0f3b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:09.631027 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:09.637875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab261d-885a-478c-a321-8773bdeb233d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:09.638712 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab261d-885a-478c-a321-8773bdeb233d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:09.639115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab261d-885a-478c-a321-8773bdeb233d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:09.640698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 211/423] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:00:09.641760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 213/424] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:09 2022] GET /identity/v3/role_assignments?group.id=5eb869bfc0144505991ad0f131b255f4&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:09.646771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100c26-c865-4faa-86a0-d021703caa47 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:09.647321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100c26-c865-4faa-86a0-d021703caa47 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:09.647817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100c26-c865-4faa-86a0-d021703caa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:09.654016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:09.691148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0a100c26-c865-4faa-86a0-d021703caa47 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:09.693221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0a100c26-c865-4faa-86a0-d021703caa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:09.810883 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 212/425] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:09.863684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f5147-a597-405c-8d08-d98bb416809b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:09.864120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f5147-a597-405c-8d08-d98bb416809b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:09.864415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f5147-a597-405c-8d08-d98bb416809b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:09.866728 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 214/426] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:09.869838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a100c26-c865-4faa-86a0-d021703caa47 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:09.885586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ab2fc-4696-4b2e-98d4-5aac99b05397 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:09.885959 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ab2fc-4696-4b2e-98d4-5aac99b05397 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:09.886157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ab2fc-4696-4b2e-98d4-5aac99b05397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:09.914455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f66ab2fc-4696-4b2e-98d4-5aac99b05397 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:09.916325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f66ab2fc-4696-4b2e-98d4-5aac99b05397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:10.018137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 215/427] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:10.036123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a100c26-c865-4faa-86a0-d021703caa47 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:10.051414 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ab2fc-4696-4b2e-98d4-5aac99b05397 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:10.079531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:10.087854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94975015-485a-4c24-a170-65d69fc413e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:10.089143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94975015-485a-4c24-a170-65d69fc413e2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:10.089786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94975015-485a-4c24-a170-65d69fc413e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:10.090283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94975015-485a-4c24-a170-65d69fc413e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:10.104070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94975015-485a-4c24-a170-65d69fc413e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-94975015-485a-4c24-a170-65d69fc413e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:10.113643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:10.114663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:00:10.115570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:10.118578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 213/428] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:10.125987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94975015-485a-4c24-a170-65d69fc413e2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:10.162667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ab2fc-4696-4b2e-98d4-5aac99b05397 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:10.194457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:10.202522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175552ff-125d-48b3-9bc6-bd7aaeb37f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:10.203916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175552ff-125d-48b3-9bc6-bd7aaeb37f4f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:10.204629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175552ff-125d-48b3-9bc6-bd7aaeb37f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:10.205073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175552ff-125d-48b3-9bc6-bd7aaeb37f4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:10.222247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175552ff-125d-48b3-9bc6-bd7aaeb37f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-175552ff-125d-48b3-9bc6-bd7aaeb37f4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:10.230242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:10.231287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:10.232869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 216/429] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:10.238971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175552ff-125d-48b3-9bc6-bd7aaeb37f4f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:10.267043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94975015-485a-4c24-a170-65d69fc413e2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:10.309700 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8d1d1-c31c-4916-9d22-5f747c888470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:10.311555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8d1d1-c31c-4916-9d22-5f747c888470 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:10.312035 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8d1d1-c31c-4916-9d22-5f747c888470 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:10.312531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8d1d1-c31c-4916-9d22-5f747c888470 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:10.313606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8d1d1-c31c-4916-9d22-5f747c888470 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:10.314157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8d1d1-c31c-4916-9d22-5f747c888470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:10.316046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8d1d1-c31c-4916-9d22-5f747c888470 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:10.326738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 214/430] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 15:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:10.332870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8d1d1-c31c-4916-9d22-5f747c888470 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:10.374420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175552ff-125d-48b3-9bc6-bd7aaeb37f4f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:10.400437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:10.412151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377f09-40a2-409d-83a1-72038acc5abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:10.412942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377f09-40a2-409d-83a1-72038acc5abb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:10.413172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377f09-40a2-409d-83a1-72038acc5abb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:10.413451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377f09-40a2-409d-83a1-72038acc5abb None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:10.414229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377f09-40a2-409d-83a1-72038acc5abb None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:10.414552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377f09-40a2-409d-83a1-72038acc5abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:10.416403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377f09-40a2-409d-83a1-72038acc5abb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:10.429827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 217/431] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 15:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:10.432012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377f09-40a2-409d-83a1-72038acc5abb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:10.456964 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8d1d1-c31c-4916-9d22-5f747c888470 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:10.490832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:10.496621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333848-ed86-4549-9f58-d348b06c5d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:10.497694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333848-ed86-4549-9f58-d348b06c5d6b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:10.498187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333848-ed86-4549-9f58-d348b06c5d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:10.498792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333848-ed86-4549-9f58-d348b06c5d6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:10.545352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377f09-40a2-409d-83a1-72038acc5abb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:10.582387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c333848-ed86-4549-9f58-d348b06c5d6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:10.584558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c333848-ed86-4549-9f58-d348b06c5d6b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:10.585712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15f905-7d1e-428a-b05c-53f991321acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:10.586469 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15f905-7d1e-428a-b05c-53f991321acd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:10.586850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15f905-7d1e-428a-b05c-53f991321acd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:10.587226 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15f905-7d1e-428a-b05c-53f991321acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:10.648398 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:10.667225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15f905-7d1e-428a-b05c-53f991321acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:10.669070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15f905-7d1e-428a-b05c-53f991321acd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:10.707421 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 215/432] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:10.709094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448926c-f5b9-4412-8713-eb25cb285aac None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:10.709602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448926c-f5b9-4412-8713-eb25cb285aac None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:10.710205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448926c-f5b9-4412-8713-eb25cb285aac None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:10.711831 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 216/433] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:10.712676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448926c-f5b9-4412-8713-eb25cb285aac None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:10.726442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:10.779653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 218/434] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:10.785586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ef9e4-ad6c-4bd6-b48d-7ed8dea4151c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:10.785876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ef9e4-ad6c-4bd6-b48d-7ed8dea4151c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:10.786151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ef9e4-ad6c-4bd6-b48d-7ed8dea4151c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:10.804055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6b8ef9e4-ad6c-4bd6-b48d-7ed8dea4151c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:10.805249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6b8ef9e4-ad6c-4bd6-b48d-7ed8dea4151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:10.833377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448926c-f5b9-4412-8713-eb25cb285aac None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:10.870293 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c2b2-a21f-436e-b5c9-0b0af89f0787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:10.871147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c2b2-a21f-436e-b5c9-0b0af89f0787 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:10.871469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c2b2-a21f-436e-b5c9-0b0af89f0787 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:10.872088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c2b2-a21f-436e-b5c9-0b0af89f0787 None admin] PATH_INFO: `/v3/projects/b2ac89cfedcc4836b5603444826c7753` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:10.873982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5c2b2-a21f-436e-b5c9-0b0af89f0787 None admin] RBAC: Authorizing `identity:get_project(project_id=b2ac89cfedcc4836b5603444826c7753)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:10.875415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5c2b2-a21f-436e-b5c9-0b0af89f0787 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:10.881509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 217/435] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:10 2022] GET /identity/v3/projects/b2ac89cfedcc4836b5603444826c7753 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:10.881509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c2b2-a21f-436e-b5c9-0b0af89f0787 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:10.886648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 219/436] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:10.890500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ef9e4-ad6c-4bd6-b48d-7ed8dea4151c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:10.907928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:10.997045 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c2b2-a21f-436e-b5c9-0b0af89f0787 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:10.998565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:11.022059 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ef9e4-ad6c-4bd6-b48d-7ed8dea4151c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:11.041610 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5f2b1-c0be-4435-953b-d0434447b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:11.042473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5f2b1-c0be-4435-953b-d0434447b728 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.042760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5f2b1-c0be-4435-953b-d0434447b728 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.043037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5f2b1-c0be-4435-953b-d0434447b728 None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.044531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5f2b1-c0be-4435-953b-d0434447b728 None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:11.046016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5f2b1-c0be-4435-953b-d0434447b728 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:11.048377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 218/437] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:10 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:11.049197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5f2b1-c0be-4435-953b-d0434447b728 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:11.080298 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cc4a2-6271-41ab-b74d-2cdd6d6ee468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:11.081042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc4a2-6271-41ab-b74d-2cdd6d6ee468 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.081325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc4a2-6271-41ab-b74d-2cdd6d6ee468 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.081633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cc4a2-6271-41ab-b74d-2cdd6d6ee468 None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.083076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cc4a2-6271-41ab-b74d-2cdd6d6ee468 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:11.084817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cc4a2-6271-41ab-b74d-2cdd6d6ee468 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:11.086926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 220/438] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:10 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:11.087960 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cc4a2-6271-41ab-b74d-2cdd6d6ee468 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:11.172760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:11.183656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5f2b1-c0be-4435-953b-d0434447b728 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:11.203787 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cc4a2-6271-41ab-b74d-2cdd6d6ee468 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:11.226105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d685b-19d9-4a72-a2c6-afebd22ee3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:11.226969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d685b-19d9-4a72-a2c6-afebd22ee3ff None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.227318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d685b-19d9-4a72-a2c6-afebd22ee3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.227643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d685b-19d9-4a72-a2c6-afebd22ee3ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.241568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d685b-19d9-4a72-a2c6-afebd22ee3ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:11.249344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d74821-fef5-4762-8490-504d7e3e8370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:11.250264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d74821-fef5-4762-8490-504d7e3e8370 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.250547 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d74821-fef5-4762-8490-504d7e3e8370 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.250822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d74821-fef5-4762-8490-504d7e3e8370 None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.252037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d74821-fef5-4762-8490-504d7e3e8370 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:11.253558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d74821-fef5-4762-8490-504d7e3e8370 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7e0d685b-19d9-4a72-a2c6-afebd22ee3ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:11.254324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:11.255201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:11.256011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:11.256629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 221/439] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:11 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:11.256629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d74821-fef5-4762-8490-504d7e3e8370 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:11.261757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 219/440] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:00:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:11.264091 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d685b-19d9-4a72-a2c6-afebd22ee3ff None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:11.286335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:11.383068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d74821-fef5-4762-8490-504d7e3e8370 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:11.388810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d685b-19d9-4a72-a2c6-afebd22ee3ff None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:11.422520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07408e6-7f7c-4e4f-85f8-5fdfc4b9e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:11.423187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07408e6-7f7c-4e4f-85f8-5fdfc4b9e827 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.423506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07408e6-7f7c-4e4f-85f8-5fdfc4b9e827 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.423838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07408e6-7f7c-4e4f-85f8-5fdfc4b9e827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.424780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07408e6-7f7c-4e4f-85f8-5fdfc4b9e827 None admin] RBAC: Adding query filter params (group.id=5eb869bfc0144505991ad0f131b255f4, role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=b2ac89cfedcc4836b5603444826c7753) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:11.425313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07408e6-7f7c-4e4f-85f8-5fdfc4b9e827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:11.427335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07408e6-7f7c-4e4f-85f8-5fdfc4b9e827 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:11.429012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de061ff7-bb39-410f-8a89-e9f7fdd2ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:11.429877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061ff7-bb39-410f-8a89-e9f7fdd2ee9e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.430082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061ff7-bb39-410f-8a89-e9f7fdd2ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.430322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061ff7-bb39-410f-8a89-e9f7fdd2ee9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.431162 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de061ff7-bb39-410f-8a89-e9f7fdd2ee9e None admin] RBAC: Adding query filter params (group.id=5eb869bfc0144505991ad0f131b255f4, role.id=fefbf89e7cb947a4a9651f4554c49df8, scope.project.id=6792456cc69f4d958161cf85839a9443) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:11.431478 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de061ff7-bb39-410f-8a89-e9f7fdd2ee9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:11.432933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de061ff7-bb39-410f-8a89-e9f7fdd2ee9e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:11.437575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 222/441] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:11 2022] GET /identity/v3/role_assignments?group.id=5eb869bfc0144505991ad0f131b255f4&scope.project.id=b2ac89cfedcc4836b5603444826c7753&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:11.438458 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07408e6-7f7c-4e4f-85f8-5fdfc4b9e827 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:11.451373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 220/442] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:11 2022] GET /identity/v3/role_assignments?group.id=5eb869bfc0144505991ad0f131b255f4&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=fefbf89e7cb947a4a9651f4554c49df8 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:11.556551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:11.580693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07408e6-7f7c-4e4f-85f8-5fdfc4b9e827 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:11.610939 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe411f-8347-4f75-a017-54a93d6ed50f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.611339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe411f-8347-4f75-a017-54a93d6ed50f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.611541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe411f-8347-4f75-a017-54a93d6ed50f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.613105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 221/443] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:00:11.620387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82066a-11b2-4b7b-bdda-4e0f925387a3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.620995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82066a-11b2-4b7b-bdda-4e0f925387a3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.621738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82066a-11b2-4b7b-bdda-4e0f925387a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.630399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1fb29-6d08-4922-9960-19961fe0a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:11.631081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1fb29-6d08-4922-9960-19961fe0a636 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.631364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1fb29-6d08-4922-9960-19961fe0a636 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.631641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1fb29-6d08-4922-9960-19961fe0a636 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.632737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1fb29-6d08-4922-9960-19961fe0a636 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:11.633046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1fb29-6d08-4922-9960-19961fe0a636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:11.635505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1fb29-6d08-4922-9960-19961fe0a636 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:11.645328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 223/444] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:11.651696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1fb29-6d08-4922-9960-19961fe0a636 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:11.652004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ba82066a-11b2-4b7b-bdda-4e0f925387a3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:11.653140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ba82066a-11b2-4b7b-bdda-4e0f925387a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:11.675539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:11.757273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 222/445] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:00:11.785990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82066a-11b2-4b7b-bdda-4e0f925387a3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:11.800837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1fb29-6d08-4922-9960-19961fe0a636 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:11.843042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156c34-416e-4372-81b7-b3d87b6b2ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:11.844010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156c34-416e-4372-81b7-b3d87b6b2ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.844324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156c34-416e-4372-81b7-b3d87b6b2ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.844609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156c34-416e-4372-81b7-b3d87b6b2ca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:11.867290 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:11.943075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82066a-11b2-4b7b-bdda-4e0f925387a3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:11.952583 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156c34-416e-4372-81b7-b3d87b6b2ca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:11.954249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156c34-416e-4372-81b7-b3d87b6b2ca9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:11.989707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db05a68-91f3-453f-b314-efaf2027c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:11.990891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db05a68-91f3-453f-b314-efaf2027c801 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:11.991200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db05a68-91f3-453f-b314-efaf2027c801 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:11.991497 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db05a68-91f3-453f-b314-efaf2027c801 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:12.006027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db05a68-91f3-453f-b314-efaf2027c801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9db05a68-91f3-453f-b314-efaf2027c801 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:12.013958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:12.015068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:12.016154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 223/446] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:12.021021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db05a68-91f3-453f-b314-efaf2027c801 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:12.025374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:12.093549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 224/447] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:12.101829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156c34-416e-4372-81b7-b3d87b6b2ca9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:12.161946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db05a68-91f3-453f-b314-efaf2027c801 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:12.163429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:12.216893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ade069-6b3d-46e6-abd4-6a2bffe729dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:12.218078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ade069-6b3d-46e6-abd4-6a2bffe729dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:12.218576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ade069-6b3d-46e6-abd4-6a2bffe729dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:12.219174 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ade069-6b3d-46e6-abd4-6a2bffe729dc None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:12.220442 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ade069-6b3d-46e6-abd4-6a2bffe729dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:12.221030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ade069-6b3d-46e6-abd4-6a2bffe729dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:12.223552 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ade069-6b3d-46e6-abd4-6a2bffe729dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:12.233005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156c34-416e-4372-81b7-b3d87b6b2ca9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:12.237694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 224/448] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:12.242425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ade069-6b3d-46e6-abd4-6a2bffe729dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:12.279381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfe74b-f343-468d-b30b-1b74f622b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:12.280254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe74b-f343-468d-b30b-1b74f622b21d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:12.280543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe74b-f343-468d-b30b-1b74f622b21d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:12.280973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe74b-f343-468d-b30b-1b74f622b21d None admin] PATH_INFO: `/v3/projects/6792456cc69f4d958161cf85839a9443` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:12.282440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfe74b-f343-468d-b30b-1b74f622b21d None admin] RBAC: Authorizing `identity:get_project(project_id=6792456cc69f4d958161cf85839a9443)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:12.284189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfe74b-f343-468d-b30b-1b74f622b21d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:12.286559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 225/449] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:12 2022] GET /identity/v3/projects/6792456cc69f4d958161cf85839a9443 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:12.292257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfe74b-f343-468d-b30b-1b74f622b21d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:12.324334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:12.379591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ade069-6b3d-46e6-abd4-6a2bffe729dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:12.424368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504594df-3b9e-4225-80f8-49b381f1423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:12.425109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504594df-3b9e-4225-80f8-49b381f1423b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:12.425394 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504594df-3b9e-4225-80f8-49b381f1423b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:12.425749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504594df-3b9e-4225-80f8-49b381f1423b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:12.441788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfe74b-f343-468d-b30b-1b74f622b21d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:12.458547 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:12.483511 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35fcef-8edc-418b-bd15-f334cb016601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:12.484463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35fcef-8edc-418b-bd15-f334cb016601 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:12.484820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35fcef-8edc-418b-bd15-f334cb016601 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:12.485137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35fcef-8edc-418b-bd15-f334cb016601 None admin] PATH_INFO: `/v3/groups/5eb869bfc0144505991ad0f131b255f4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:12.486521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35fcef-8edc-418b-bd15-f334cb016601 None admin] RBAC: Authorizing `identity:get_group(group_id=5eb869bfc0144505991ad0f131b255f4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:12.488086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35fcef-8edc-418b-bd15-f334cb016601 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:12.489984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 226/450] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:12 2022] GET /identity/v3/groups/5eb869bfc0144505991ad0f131b255f4 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:12.496373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35fcef-8edc-418b-bd15-f334cb016601 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:12.504082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504594df-3b9e-4225-80f8-49b381f1423b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:12.505640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504594df-3b9e-4225-80f8-49b381f1423b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:12.574204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:12.606601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35fcef-8edc-418b-bd15-f334cb016601 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:12.615695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 225/451] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 15:00:12.621789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504594df-3b9e-4225-80f8-49b381f1423b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:12.644505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d110933-c7db-4eb0-aab8-dbbee4e2fcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:12.645071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d110933-c7db-4eb0-aab8-dbbee4e2fcfe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:12.645351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d110933-c7db-4eb0-aab8-dbbee4e2fcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:12.645662 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d110933-c7db-4eb0-aab8-dbbee4e2fcfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:12.646621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d110933-c7db-4eb0-aab8-dbbee4e2fcfe None admin] RBAC: Adding query filter params (group.id=5eb869bfc0144505991ad0f131b255f4, role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=6792456cc69f4d958161cf85839a9443) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:12.646940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d110933-c7db-4eb0-aab8-dbbee4e2fcfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:12.648376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d110933-c7db-4eb0-aab8-dbbee4e2fcfe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:12.655435 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 227/452] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:12 2022] GET /identity/v3/role_assignments?group.id=5eb869bfc0144505991ad0f131b255f4&scope.project.id=6792456cc69f4d958161cf85839a9443&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:12.760040 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504594df-3b9e-4225-80f8-49b381f1423b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:12.805261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb35407-754f-4a98-9ef7-e8fb2a95bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:12.806248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb35407-754f-4a98-9ef7-e8fb2a95bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:12.806549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb35407-754f-4a98-9ef7-e8fb2a95bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:12.806874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb35407-754f-4a98-9ef7-e8fb2a95bdc8 None admin] PATH_INFO: `/v3/projects/48272287173249c5b6cf381e320026f5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:12.808263 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb35407-754f-4a98-9ef7-e8fb2a95bdc8 None admin] RBAC: Authorizing `identity:get_project(project_id=48272287173249c5b6cf381e320026f5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:12.810412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb35407-754f-4a98-9ef7-e8fb2a95bdc8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:12.813158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 226/453] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:00:12 2022] GET /identity/v3/projects/48272287173249c5b6cf381e320026f5 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:12.819393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d110933-c7db-4eb0-aab8-dbbee4e2fcfe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:12.880693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:12.953381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d110933-c7db-4eb0-aab8-dbbee4e2fcfe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:13.000092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838045a-e564-49dd-a0c1-9af71479d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:13.001426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838045a-e564-49dd-a0c1-9af71479d140 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:13.002331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838045a-e564-49dd-a0c1-9af71479d140 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:13.002331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838045a-e564-49dd-a0c1-9af71479d140 None admin] PATH_INFO: `/v3/groups/5ca2700c8b0048da804ec178bfc92c37` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:13.003571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838045a-e564-49dd-a0c1-9af71479d140 None admin] RBAC: Authorizing `identity:get_group(group_id=5ca2700c8b0048da804ec178bfc92c37)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:13.005148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838045a-e564-49dd-a0c1-9af71479d140 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:13.007030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 228/454] 10.222.0.90 () {56 vars in 1180 bytes} [Tue Jun 21 15:00:12 2022] GET /identity/v3/groups/5ca2700c8b0048da804ec178bfc92c37 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:13.014335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb35407-754f-4a98-9ef7-e8fb2a95bdc8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:13.061995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:13.143689 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb35407-754f-4a98-9ef7-e8fb2a95bdc8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:13.179301 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191ddf-ce88-4f1d-b3ff-ee187100db68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:13.179960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191ddf-ce88-4f1d-b3ff-ee187100db68 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:13.180290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191ddf-ce88-4f1d-b3ff-ee187100db68 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:13.180512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191ddf-ce88-4f1d-b3ff-ee187100db68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:13.181353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191ddf-ce88-4f1d-b3ff-ee187100db68 None admin] RBAC: Adding query filter params (group.id=5ca2700c8b0048da804ec178bfc92c37, role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=48272287173249c5b6cf381e320026f5) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:13.181701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191ddf-ce88-4f1d-b3ff-ee187100db68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:13.183194 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191ddf-ce88-4f1d-b3ff-ee187100db68 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:13.190033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 227/455] 10.222.0.90 () {56 vars in 1376 bytes} [Tue Jun 21 15:00:13 2022] GET /identity/v3/role_assignments?group.id=5ca2700c8b0048da804ec178bfc92c37&scope.project.id=48272287173249c5b6cf381e320026f5&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:16.354123 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989961-a03d-4fb2-83ed-c45bcb1891ee None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:16.355092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989961-a03d-4fb2-83ed-c45bcb1891ee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:16.355576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e989961-a03d-4fb2-83ed-c45bcb1891ee None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:16.358336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 229/456] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:16.364204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe67a-a88d-47d8-84e6-1f2ae5e8475c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:16.365106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe67a-a88d-47d8-84e6-1f2ae5e8475c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:16.365643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe67a-a88d-47d8-84e6-1f2ae5e8475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:16.394489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-66ffe67a-a88d-47d8-84e6-1f2ae5e8475c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:16.396151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-66ffe67a-a88d-47d8-84e6-1f2ae5e8475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:16.502592 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 228/457] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:16.546219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989961-a03d-4fb2-83ed-c45bcb1891ee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:16.700130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e989961-a03d-4fb2-83ed-c45bcb1891ee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:16.729823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:16.762467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567832a8-b3a5-4ef0-91fc-9c9a5514bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:16.763487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567832a8-b3a5-4ef0-91fc-9c9a5514bb5b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:16.763813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567832a8-b3a5-4ef0-91fc-9c9a5514bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:16.764143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567832a8-b3a5-4ef0-91fc-9c9a5514bb5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:16.780536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567832a8-b3a5-4ef0-91fc-9c9a5514bb5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:16.782365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567832a8-b3a5-4ef0-91fc-9c9a5514bb5b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:16.790384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a5cea-8d3c-42c6-8fff-3c18aa012e58 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:16.791084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a5cea-8d3c-42c6-8fff-3c18aa012e58 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:16.791650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a5cea-8d3c-42c6-8fff-3c18aa012e58 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:16.794230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 229/458] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:16.801486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec54f09-e989-4ada-8363-b35c0435ae89 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:16.802131 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec54f09-e989-4ada-8363-b35c0435ae89 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:16.802700 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec54f09-e989-4ada-8363-b35c0435ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-567832a8-b3a5-4ef0-91fc-9c9a5514bb5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:16.812962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:16.814136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:16.815540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:16.815540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:16.815540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:16.815540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:16.815540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 230/459] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:16.815540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c493fa-e542-46d7-bd94-18bd379d730a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:16.815540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c493fa-e542-46d7-bd94-18bd379d730a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:16.816128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c493fa-e542-46d7-bd94-18bd379d730a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:16.817596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 231/460] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:16.818448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c493fa-e542-46d7-bd94-18bd379d730a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:16.838035 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8ec54f09-e989-4ada-8363-b35c0435ae89 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:16.840113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ec54f09-e989-4ada-8363-b35c0435ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:16.874457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:16.954219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 230/461] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:00:16.955397 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c493fa-e542-46d7-bd94-18bd379d730a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:16.955983 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2181cb-52bc-4d38-98e8-041cbea70680 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:16.956377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2181cb-52bc-4d38-98e8-041cbea70680 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:16.956759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2181cb-52bc-4d38-98e8-041cbea70680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:16.983615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1e2181cb-52bc-4d38-98e8-041cbea70680 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:16.986324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1e2181cb-52bc-4d38-98e8-041cbea70680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:16.997689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c466a93-c1d0-4d94-b24c-49d46e1df626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:16.998712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c466a93-c1d0-4d94-b24c-49d46e1df626 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:16.999336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c466a93-c1d0-4d94-b24c-49d46e1df626 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:16.999815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c466a93-c1d0-4d94-b24c-49d46e1df626 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:17.000740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c466a93-c1d0-4d94-b24c-49d46e1df626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:17.001267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c466a93-c1d0-4d94-b24c-49d46e1df626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:17.002911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c466a93-c1d0-4d94-b24c-49d46e1df626 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:17.018928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 232/462] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:17.020230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c466a93-c1d0-4d94-b24c-49d46e1df626 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:17.051864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:17.096750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 231/463] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:17.098149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2181cb-52bc-4d38-98e8-041cbea70680 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:17.159404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c466a93-c1d0-4d94-b24c-49d46e1df626 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:17.201429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1503a2-2958-4143-b1ac-16d0285efc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:17.202322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1503a2-2958-4143-b1ac-16d0285efc6e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:17.202611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1503a2-2958-4143-b1ac-16d0285efc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:17.202890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1503a2-2958-4143-b1ac-16d0285efc6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:17.214676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1503a2-2958-4143-b1ac-16d0285efc6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:17.216841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1503a2-2958-4143-b1ac-16d0285efc6e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:17.216962 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:17.229151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2181cb-52bc-4d38-98e8-041cbea70680 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0f1503a2-2958-4143-b1ac-16d0285efc6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:17.249367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:17.250829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:17.252124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:17.252124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:17.252124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:17.252124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:17.253906 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 233/464] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:17.255381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747412dc-ff20-4e44-a299-5af87d3fb533 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:17.255798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747412dc-ff20-4e44-a299-5af87d3fb533 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:17.256199 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747412dc-ff20-4e44-a299-5af87d3fb533 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:17.257607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 234/465] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:17.258529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747412dc-ff20-4e44-a299-5af87d3fb533 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:17.283366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88d805-0f53-45ac-bfea-25809d28c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:17.284213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88d805-0f53-45ac-bfea-25809d28c398 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:17.284557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88d805-0f53-45ac-bfea-25809d28c398 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:17.284897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88d805-0f53-45ac-bfea-25809d28c398 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:17.285809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88d805-0f53-45ac-bfea-25809d28c398 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:17.287603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88d805-0f53-45ac-bfea-25809d28c398 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:17.325507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 232/466] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:00:17 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:00:17.325507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88d805-0f53-45ac-bfea-25809d28c398 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:17.372242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:17.401071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747412dc-ff20-4e44-a299-5af87d3fb533 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:17.449641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ea79-dc8f-46be-8541-613d07cd86cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:17.450985 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ea79-dc8f-46be-8541-613d07cd86cc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:17.451492 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ea79-dc8f-46be-8541-613d07cd86cc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:17.452000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ea79-dc8f-46be-8541-613d07cd86cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:17.465617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4ea79-dc8f-46be-8541-613d07cd86cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:17.468221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4ea79-dc8f-46be-8541-613d07cd86cc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-aad4ea79-dc8f-46be-8541-613d07cd86cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:17.488153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:17.489089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:17.490003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:17.490003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:17.490003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:17.490003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:17.497149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 235/467] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:17.499607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ecdc1-3ea6-4382-ad18-1528ae3c51ed None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:17.500114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ecdc1-3ea6-4382-ad18-1528ae3c51ed None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:17.500590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ecdc1-3ea6-4382-ad18-1528ae3c51ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:17.501905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88d805-0f53-45ac-bfea-25809d28c398 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:17.531884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-161ecdc1-3ea6-4382-ad18-1528ae3c51ed None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:17.533253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-161ecdc1-3ea6-4382-ad18-1528ae3c51ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:17.561264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c334e9-7bb6-44b0-b62b-c5a83d897b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:17.566054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c334e9-7bb6-44b0-b62b-c5a83d897b72 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:17.566054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c334e9-7bb6-44b0-b62b-c5a83d897b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:17.566365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c334e9-7bb6-44b0-b62b-c5a83d897b72 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:17.567122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c334e9-7bb6-44b0-b62b-c5a83d897b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:17.567428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c334e9-7bb6-44b0-b62b-c5a83d897b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:17.568851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c334e9-7bb6-44b0-b62b-c5a83d897b72 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:17.593854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 233/468] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:17.594846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c334e9-7bb6-44b0-b62b-c5a83d897b72 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:17.600150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:17.661142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 236/469] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:17.661142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ecdc1-3ea6-4382-ad18-1528ae3c51ed None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:17.743153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:17.787353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c334e9-7bb6-44b0-b62b-c5a83d897b72 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:17.812668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ecdc1-3ea6-4382-ad18-1528ae3c51ed None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:17.833141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0236d-c92d-477b-80dd-e464e3582110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:17.834187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0236d-c92d-477b-80dd-e464e3582110 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:17.834680 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0236d-c92d-477b-80dd-e464e3582110 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:17.835351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0236d-c92d-477b-80dd-e464e3582110 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:17.836483 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0236d-c92d-477b-80dd-e464e3582110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:17.837184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0236d-c92d-477b-80dd-e464e3582110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:17.838827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0236d-c92d-477b-80dd-e464e3582110 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:17.857865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 234/470] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:17.859222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0236d-c92d-477b-80dd-e464e3582110 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:17.865591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f139536-603f-4cb7-9d4e-e402ecbda06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:17.866377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139536-603f-4cb7-9d4e-e402ecbda06f None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:17.866710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139536-603f-4cb7-9d4e-e402ecbda06f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:17.867036 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f139536-603f-4cb7-9d4e-e402ecbda06f None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:17.867798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f139536-603f-4cb7-9d4e-e402ecbda06f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:17.869375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f139536-603f-4cb7-9d4e-e402ecbda06f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:17.904826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 237/471] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:00:17 2022] POST /identity/v3/users => generated 246 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:00:17.905920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f139536-603f-4cb7-9d4e-e402ecbda06f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:17.974445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:18.035292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0236d-c92d-477b-80dd-e464e3582110 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:18.063509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f139536-603f-4cb7-9d4e-e402ecbda06f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:18.081297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:18.089501 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481e634-8d17-452a-b732-3aa2bc27d24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:18.090484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481e634-8d17-452a-b732-3aa2bc27d24c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:18.092725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481e634-8d17-452a-b732-3aa2bc27d24c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:18.092725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481e634-8d17-452a-b732-3aa2bc27d24c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:18.104762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481e634-8d17-452a-b732-3aa2bc27d24c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:18.106545 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481e634-8d17-452a-b732-3aa2bc27d24c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:18.125936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55191bec-750a-404d-bd89-99efcf4fa005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:18.126953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191bec-750a-404d-bd89-99efcf4fa005 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:18.127350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191bec-750a-404d-bd89-99efcf4fa005 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:18.127742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191bec-750a-404d-bd89-99efcf4fa005 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4481e634-8d17-452a-b732-3aa2bc27d24c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:18.128221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:18.129185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:18.130279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:18.130279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:18.130279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:18.130279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:18.130506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55191bec-750a-404d-bd89-99efcf4fa005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:18.130579 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 235/472] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:18.131262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e72d2-4443-4a28-80df-cec5d2115423 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:18.131553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e72d2-4443-4a28-80df-cec5d2115423 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:18.131834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e72d2-4443-4a28-80df-cec5d2115423 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:18.133322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 236/473] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:18.137617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55191bec-750a-404d-bd89-99efcf4fa005 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:18.138537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e72d2-4443-4a28-80df-cec5d2115423 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:18.175678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 238/474] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:00:17 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:00:18.177166 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79cf5-f91c-4263-a951-df4a4b577d01 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:18.181982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79cf5-f91c-4263-a951-df4a4b577d01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:18.182893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79cf5-f91c-4263-a951-df4a4b577d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:18.210740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-79c79cf5-f91c-4263-a951-df4a4b577d01 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:18.212106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-79c79cf5-f91c-4263-a951-df4a4b577d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:18.316268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e72d2-4443-4a28-80df-cec5d2115423 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:18.323964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 239/475] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:18.337804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:18.363888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731d0c9-d353-4dd4-be3e-bc609cd10c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:18.364671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731d0c9-d353-4dd4-be3e-bc609cd10c87 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:18.365028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731d0c9-d353-4dd4-be3e-bc609cd10c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:18.365157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79cf5-f91c-4263-a951-df4a4b577d01 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:18.365336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731d0c9-d353-4dd4-be3e-bc609cd10c87 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:18.366214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731d0c9-d353-4dd4-be3e-bc609cd10c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:18.366538 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731d0c9-d353-4dd4-be3e-bc609cd10c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:18.368420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731d0c9-d353-4dd4-be3e-bc609cd10c87 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:18.386324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 237/476] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:18.392549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731d0c9-d353-4dd4-be3e-bc609cd10c87 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:18.541066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:18.546272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c79cf5-f91c-4263-a951-df4a4b577d01 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:18.553060 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731d0c9-d353-4dd4-be3e-bc609cd10c87 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:18.602451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:18.603333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:18.603623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:18.604386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:18.605441 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:18.607470 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:18.612252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048dc3e-a7af-435d-b8ea-4f44c4fc2218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:18.613117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048dc3e-a7af-435d-b8ea-4f44c4fc2218 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:18.613510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048dc3e-a7af-435d-b8ea-4f44c4fc2218 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:18.613866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048dc3e-a7af-435d-b8ea-4f44c4fc2218 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:18.615515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048dc3e-a7af-435d-b8ea-4f44c4fc2218 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:18.616608 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048dc3e-a7af-435d-b8ea-4f44c4fc2218 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:18.617239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.sql.core [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 15:00:18.617239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 15:00:18.617239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [parameters: {'id': 'c7513e0e5652415a89f7370d8f72a7ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 15:00:18.617239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jun 21 15:00:18.645531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return ref.to_dict() Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:00:18.646861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application yield resource Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise self.value Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application session.commit() Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 15:00:18.648585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.flush() Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application compat.raise_( Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 15:00:18.651120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:00:18.653330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:00:18.655646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [parameters: {'id': 'c7513e0e5652415a89f7370d8f72a7ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:18.659407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 15:00:18.661466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:18.663502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 238/477] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:00:18 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:00:18.663647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 240/478] 10.222.0.90 () {60 vars in 1131 bytes} [Tue Jun 21 15:00:18 2022] POST /identity/v3/roles => generated 144 bytes in 295 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:18.671486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048dc3e-a7af-435d-b8ea-4f44c4fc2218 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:18.745620 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:18.886442 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048dc3e-a7af-435d-b8ea-4f44c4fc2218 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:18.942841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d0692-f223-45c2-a924-501b5c51d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:18.943730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0692-f223-45c2-a924-501b5c51d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:18.944075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0692-f223-45c2-a924-501b5c51d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:18.944366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0692-f223-45c2-a924-501b5c51d1c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:18.958968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0692-f223-45c2-a924-501b5c51d1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6f3d0692-f223-45c2-a924-501b5c51d1c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:18.969956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:18.970906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 15:00:18.971751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:18.972408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 239/479] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:00:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:18.978289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:19.108025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f303c-e04e-4094-bcfb-04c7c88124a4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:19.151881 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7364c15-2530-4300-b34d-ad077c1bf04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:19.152498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7364c15-2530-4300-b34d-ad077c1bf04f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:19.152800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7364c15-2530-4300-b34d-ad077c1bf04f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:19.153152 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7364c15-2530-4300-b34d-ad077c1bf04f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:19.154030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7364c15-2530-4300-b34d-ad077c1bf04f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:19.154376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7364c15-2530-4300-b34d-ad077c1bf04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:19.155894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7364c15-2530-4300-b34d-ad077c1bf04f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:19.165754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 241/480] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:19.979070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a7f6-c2d0-4839-b633-39363454ba5f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:19.979613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a7f6-c2d0-4839-b633-39363454ba5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:19.979692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a7f6-c2d0-4839-b633-39363454ba5f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:19.982040 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 240/481] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:19.988578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816d03-9831-46bb-9d5b-e5792574a796 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:19.989598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816d03-9831-46bb-9d5b-e5792574a796 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:19.990143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816d03-9831-46bb-9d5b-e5792574a796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:20.017868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e0816d03-9831-46bb-9d5b-e5792574a796 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:20.019438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e0816d03-9831-46bb-9d5b-e5792574a796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:20.050424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:20.109218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 242/482] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:00:20.150943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a7f6-c2d0-4839-b633-39363454ba5f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:20.277400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:20.298197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a7f6-c2d0-4839-b633-39363454ba5f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:20.353584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8562b-fb05-4451-be49-cc776a2aeb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:20.354550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8562b-fb05-4451-be49-cc776a2aeb97 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:20.354853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8562b-fb05-4451-be49-cc776a2aeb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:20.355161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8562b-fb05-4451-be49-cc776a2aeb97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:20.371437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8562b-fb05-4451-be49-cc776a2aeb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fcd8562b-fb05-4451-be49-cc776a2aeb97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:20.382312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:20.383327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:20.384181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 241/483] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:20.392308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0816d03-9831-46bb-9d5b-e5792574a796 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:20.537446 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0816d03-9831-46bb-9d5b-e5792574a796 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:20.595910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961131-851c-43c9-8e79-a8ec204dc44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:20.596750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961131-851c-43c9-8e79-a8ec204dc44b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:20.597088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961131-851c-43c9-8e79-a8ec204dc44b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:20.597434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961131-851c-43c9-8e79-a8ec204dc44b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:20.598429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe961131-851c-43c9-8e79-a8ec204dc44b None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:20.598833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe961131-851c-43c9-8e79-a8ec204dc44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:20.600618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe961131-851c-43c9-8e79-a8ec204dc44b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:20.612267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 243/484] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:20.617950 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8562b-fb05-4451-be49-cc776a2aeb97 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:20.784675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8562b-fb05-4451-be49-cc776a2aeb97 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:20.843995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd83b17-c0b3-4823-9c04-671a33b0186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:20.845195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83b17-c0b3-4823-9c04-671a33b0186e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:20.845753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83b17-c0b3-4823-9c04-671a33b0186e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:20.846580 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd83b17-c0b3-4823-9c04-671a33b0186e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:20.870767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd83b17-c0b3-4823-9c04-671a33b0186e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:20.873028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd83b17-c0b3-4823-9c04-671a33b0186e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cfd83b17-c0b3-4823-9c04-671a33b0186e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:20.910692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:20.911634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:20.912523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:20.912523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:20.912523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:20.912523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:20.914782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 242/485] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:20.922703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961131-851c-43c9-8e79-a8ec204dc44b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:20.975218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:21.087922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30767d-23e1-4573-9a86-9037c9ecb29f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.088954 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30767d-23e1-4573-9a86-9037c9ecb29f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.089520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30767d-23e1-4573-9a86-9037c9ecb29f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.093271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 243/486] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:21.101850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28d458-36dc-40c8-9ddd-9388ceada221 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.102437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28d458-36dc-40c8-9ddd-9388ceada221 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.102996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28d458-36dc-40c8-9ddd-9388ceada221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.103545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961131-851c-43c9-8e79-a8ec204dc44b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:21.121876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:21.142913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5d28d458-36dc-40c8-9ddd-9388ceada221 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:21.145780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d28d458-36dc-40c8-9ddd-9388ceada221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:21.171662 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36221470-7727-4bbe-a23b-04c078e49ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:21.172759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36221470-7727-4bbe-a23b-04c078e49ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.173267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36221470-7727-4bbe-a23b-04c078e49ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.173888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36221470-7727-4bbe-a23b-04c078e49ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.174939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36221470-7727-4bbe-a23b-04c078e49ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:21.175487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36221470-7727-4bbe-a23b-04c078e49ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:21.177087 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36221470-7727-4bbe-a23b-04c078e49ed4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:21.192385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 244/487] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:21.194099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4968df-85e7-4782-b1f0-165340c31c22 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.194599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4968df-85e7-4782-b1f0-165340c31c22 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.195107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4968df-85e7-4782-b1f0-165340c31c22 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.196817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 245/488] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:21.199980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4968df-85e7-4782-b1f0-165340c31c22 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:21.253655 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 244/489] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:00:21.260555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c92ed-9108-46f0-8db4-67ec38c9dc16 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.261664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c92ed-9108-46f0-8db4-67ec38c9dc16 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.262185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c92ed-9108-46f0-8db4-67ec38c9dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.296965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2b3c92ed-9108-46f0-8db4-67ec38c9dc16 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:21.299451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2b3c92ed-9108-46f0-8db4-67ec38c9dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:21.319680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:21.350341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4968df-85e7-4782-b1f0-165340c31c22 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:21.392490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f6a93-4b8e-44c2-80b7-07ea114572aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:21.393969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f6a93-4b8e-44c2-80b7-07ea114572aa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.394439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f6a93-4b8e-44c2-80b7-07ea114572aa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.394898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f6a93-4b8e-44c2-80b7-07ea114572aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.406791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f6a93-4b8e-44c2-80b7-07ea114572aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:21.408976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f6a93-4b8e-44c2-80b7-07ea114572aa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:21.427854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 245/490] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-593f6a93-4b8e-44c2-80b7-07ea114572aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:21.433641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:21.435501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:00:21.437319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:21.439189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 246/491] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:21.439899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f6a93-4b8e-44c2-80b7-07ea114572aa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:21.441449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c92ed-9108-46f0-8db4-67ec38c9dc16 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:21.568409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:21.592911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f6a93-4b8e-44c2-80b7-07ea114572aa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:21.617824 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c92ed-9108-46f0-8db4-67ec38c9dc16 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:21.665018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa9b71-8411-4bb0-b6dc-e8b25ba0937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:21.665781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa9b71-8411-4bb0-b6dc-e8b25ba0937a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.666106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa9b71-8411-4bb0-b6dc-e8b25ba0937a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.666382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa9b71-8411-4bb0-b6dc-e8b25ba0937a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.669843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8faeb-e1f1-4526-a198-5a6fa4463b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:21.671290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8faeb-e1f1-4526-a198-5a6fa4463b5d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.671784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8faeb-e1f1-4526-a198-5a6fa4463b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.672286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8faeb-e1f1-4526-a198-5a6fa4463b5d None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.673340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8faeb-e1f1-4526-a198-5a6fa4463b5d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:21.673890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8faeb-e1f1-4526-a198-5a6fa4463b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:21.675880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8faeb-e1f1-4526-a198-5a6fa4463b5d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:21.678768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:21.688677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa9b71-8411-4bb0-b6dc-e8b25ba0937a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-aefa9b71-8411-4bb0-b6dc-e8b25ba0937a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:21.698165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:21.700509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:21.702294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 247/492] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:21.704227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa9b71-8411-4bb0-b6dc-e8b25ba0937a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:21.746473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 246/493] 10.222.0.90 () {56 vars in 1137 bytes} [Tue Jun 21 15:00:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:21.746473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726d3af-41dd-4c98-991b-7bc7a0ea93cb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.746473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726d3af-41dd-4c98-991b-7bc7a0ea93cb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.746473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726d3af-41dd-4c98-991b-7bc7a0ea93cb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.746473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 247/494] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:21.746473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726d3af-41dd-4c98-991b-7bc7a0ea93cb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:21.838708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa9b71-8411-4bb0-b6dc-e8b25ba0937a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:21.882368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4950-83d7-463f-9c51-1e08282d1eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:21.883170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4950-83d7-463f-9c51-1e08282d1eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.883370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726d3af-41dd-4c98-991b-7bc7a0ea93cb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:21.883501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4950-83d7-463f-9c51-1e08282d1eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.883711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4950-83d7-463f-9c51-1e08282d1eb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.902718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4950-83d7-463f-9c51-1e08282d1eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:21.909463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cf1d4950-83d7-463f-9c51-1e08282d1eb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:21.910837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:21.911754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 248/495] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:21.912926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4950-83d7-463f-9c51-1e08282d1eb0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:21.940912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ea7eb-5262-40fc-9ff8-37e0a7efeaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:21.941638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ea7eb-5262-40fc-9ff8-37e0a7efeaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.941936 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ea7eb-5262-40fc-9ff8-37e0a7efeaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.942204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ea7eb-5262-40fc-9ff8-37e0a7efeaf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.942986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ea7eb-5262-40fc-9ff8-37e0a7efeaf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:21.943343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ea7eb-5262-40fc-9ff8-37e0a7efeaf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:21.944869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ea7eb-5262-40fc-9ff8-37e0a7efeaf7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:21.955707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 248/496] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:21.956858 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9454-a647-4b33-917b-b099c2aee041 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:21.957143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9454-a647-4b33-917b-b099c2aee041 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:21.957426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9454-a647-4b33-917b-b099c2aee041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:21.987461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-51db9454-a647-4b33-917b-b099c2aee041 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:21.989092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-51db9454-a647-4b33-917b-b099c2aee041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:21.992317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:22.048765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4950-83d7-463f-9c51-1e08282d1eb0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:22.088894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c6dde-7615-44e8-9263-7819a3a30e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:22.089814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c6dde-7615-44e8-9263-7819a3a30e80 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.090320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c6dde-7615-44e8-9263-7819a3a30e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.090734 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c6dde-7615-44e8-9263-7819a3a30e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.091418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 249/497] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:22.092354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db9454-a647-4b33-917b-b099c2aee041 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:22.175662 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c6dde-7615-44e8-9263-7819a3a30e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:22.177547 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c6dde-7615-44e8-9263-7819a3a30e80 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:22.208303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db9454-a647-4b33-917b-b099c2aee041 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:22.223188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:22.246307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ecfaf-b15e-4016-82a8-31871d81031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:22.248166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ecfaf-b15e-4016-82a8-31871d81031e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.248458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ecfaf-b15e-4016-82a8-31871d81031e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.248740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ecfaf-b15e-4016-82a8-31871d81031e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.249583 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ecfaf-b15e-4016-82a8-31871d81031e None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:22.249854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ecfaf-b15e-4016-82a8-31871d81031e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:22.251193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:22.251332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ecfaf-b15e-4016-82a8-31871d81031e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:22.260006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 250/498] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:22.260823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ecfaf-b15e-4016-82a8-31871d81031e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:22.301725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 249/499] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:22.303095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8063b-85f2-4dea-8331-8bfe767d236e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.303384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8063b-85f2-4dea-8331-8bfe767d236e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.303664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8063b-85f2-4dea-8331-8bfe767d236e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.309369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 250/500] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:22.309369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8063b-85f2-4dea-8331-8bfe767d236e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:22.378257 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ecfaf-b15e-4016-82a8-31871d81031e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:22.415312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a0d62-0532-4a9f-b156-0ab951582b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:22.416107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a0d62-0532-4a9f-b156-0ab951582b90 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.416391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a0d62-0532-4a9f-b156-0ab951582b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.416667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a0d62-0532-4a9f-b156-0ab951582b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.419506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8063b-85f2-4dea-8331-8bfe767d236e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:22.428489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a0d62-0532-4a9f-b156-0ab951582b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:22.430011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a0d62-0532-4a9f-b156-0ab951582b90 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6f4a0d62-0532-4a9f-b156-0ab951582b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:22.448163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:22.449161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:22.450321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:22.450321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:22.450321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:22.450321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:22.450321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 251/501] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:22.450790 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a0d62-0532-4a9f-b156-0ab951582b90 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:22.460220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc1281-4d7c-478b-bb31-725d74136a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:22.460959 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc1281-4d7c-478b-bb31-725d74136a93 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.461241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc1281-4d7c-478b-bb31-725d74136a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.461545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc1281-4d7c-478b-bb31-725d74136a93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.472375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc1281-4d7c-478b-bb31-725d74136a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-afbc1281-4d7c-478b-bb31-725d74136a93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:22.480551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:22.483551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 251/502] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:22.485153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc1281-4d7c-478b-bb31-725d74136a93 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:22.487836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:22.510270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:22.586214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a0d62-0532-4a9f-b156-0ab951582b90 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:22.605225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc1281-4d7c-478b-bb31-725d74136a93 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:22.623181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b711a3-c86e-475e-815a-2237f3ce8302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:22.624189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b711a3-c86e-475e-815a-2237f3ce8302 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.624553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b711a3-c86e-475e-815a-2237f3ce8302 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.624935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b711a3-c86e-475e-815a-2237f3ce8302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.637165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b711a3-c86e-475e-815a-2237f3ce8302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:22.639559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b711a3-c86e-475e-815a-2237f3ce8302 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:22.643137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995999-8c35-49e9-b899-8d75126a5c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:22.643948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995999-8c35-49e9-b899-8d75126a5c11 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.644231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995999-8c35-49e9-b899-8d75126a5c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.644509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995999-8c35-49e9-b899-8d75126a5c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.656537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac995999-8c35-49e9-b899-8d75126a5c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-04b711a3-c86e-475e-815a-2237f3ce8302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:22.657399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:22.658477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:22.659367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:22.659367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:22.659367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:22.659367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:22.659611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac995999-8c35-49e9-b899-8d75126a5c11 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:22.659681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 252/503] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:22.660013 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20093a92-30eb-406c-9692-80235a47f299 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.660284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20093a92-30eb-406c-9692-80235a47f299 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.660561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20093a92-30eb-406c-9692-80235a47f299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.680755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-20093a92-30eb-406c-9692-80235a47f299 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ac995999-8c35-49e9-b899-8d75126a5c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:22.680965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:22.682343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:22.683398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:22.683398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:22.683398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:22.683398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:22.683629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-20093a92-30eb-406c-9692-80235a47f299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:22.685899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 252/504] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:22.686827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995999-8c35-49e9-b899-8d75126a5c11 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:22.756480 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 253/505] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:22.757250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20093a92-30eb-406c-9692-80235a47f299 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:22.764308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:22.770857 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:22.802874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995999-8c35-49e9-b899-8d75126a5c11 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:22.837550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ec25-3d40-4250-8d2f-3e372df2cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:22.838216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ec25-3d40-4250-8d2f-3e372df2cdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.838499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ec25-3d40-4250-8d2f-3e372df2cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.838773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ec25-3d40-4250-8d2f-3e372df2cdf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.839505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831ec25-3d40-4250-8d2f-3e372df2cdf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:22.839813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831ec25-3d40-4250-8d2f-3e372df2cdf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:22.841938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831ec25-3d40-4250-8d2f-3e372df2cdf2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:22.854579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 253/506] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:22.855426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ec25-3d40-4250-8d2f-3e372df2cdf2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:22.881607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20093a92-30eb-406c-9692-80235a47f299 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:22.923549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640c3ca-03e7-48c4-9524-57b83897c3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:22.924214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640c3ca-03e7-48c4-9524-57b83897c3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:22.924494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640c3ca-03e7-48c4-9524-57b83897c3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:22.924767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640c3ca-03e7-48c4-9524-57b83897c3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:22.925540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640c3ca-03e7-48c4-9524-57b83897c3f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:22.925847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640c3ca-03e7-48c4-9524-57b83897c3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:22.927224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640c3ca-03e7-48c4-9524-57b83897c3f3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:22.935925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 254/507] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:22.936752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640c3ca-03e7-48c4-9524-57b83897c3f3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:22.976203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ec25-3d40-4250-8d2f-3e372df2cdf2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.017818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:23.018545 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:23.024431 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea8296-d81a-4809-8a2e-88656d198f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.025008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea8296-d81a-4809-8a2e-88656d198f2b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.025295 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea8296-d81a-4809-8a2e-88656d198f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.025614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea8296-d81a-4809-8a2e-88656d198f2b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.026355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea8296-d81a-4809-8a2e-88656d198f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:23.026669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea8296-d81a-4809-8a2e-88656d198f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.028708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea8296-d81a-4809-8a2e-88656d198f2b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.040720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 254/508] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:23.041582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea8296-d81a-4809-8a2e-88656d198f2b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.055493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640c3ca-03e7-48c4-9524-57b83897c3f3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.093834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28286d9f-ce6b-4d3a-9846-f352993276d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.094547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28286d9f-ce6b-4d3a-9846-f352993276d5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.094772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28286d9f-ce6b-4d3a-9846-f352993276d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.095046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28286d9f-ce6b-4d3a-9846-f352993276d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.095766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28286d9f-ce6b-4d3a-9846-f352993276d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:23.096067 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28286d9f-ce6b-4d3a-9846-f352993276d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.097445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28286d9f-ce6b-4d3a-9846-f352993276d5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.110733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 255/509] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:23.111018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28286d9f-ce6b-4d3a-9846-f352993276d5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.150021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea8296-d81a-4809-8a2e-88656d198f2b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.188687 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344cd16-9e03-41df-9fb7-01333737f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.189537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344cd16-9e03-41df-9fb7-01333737f490 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.189777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344cd16-9e03-41df-9fb7-01333737f490 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.190049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344cd16-9e03-41df-9fb7-01333737f490 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.203474 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344cd16-9e03-41df-9fb7-01333737f490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.204983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344cd16-9e03-41df-9fb7-01333737f490 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9344cd16-9e03-41df-9fb7-01333737f490 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:23.223211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:23.224167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:23.225269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:23.225269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:23.225269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:23.225269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:23.225269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 255/510] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:23.225749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344cd16-9e03-41df-9fb7-01333737f490 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.247281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28286d9f-ce6b-4d3a-9846-f352993276d5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.275181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:23.291452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:23.298069 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bfa5f-2010-4c5a-9e0e-66c74dba69d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.298861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bfa5f-2010-4c5a-9e0e-66c74dba69d9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.299142 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bfa5f-2010-4c5a-9e0e-66c74dba69d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.299415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bfa5f-2010-4c5a-9e0e-66c74dba69d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.307132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bfa5f-2010-4c5a-9e0e-66c74dba69d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.308599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bfa5f-2010-4c5a-9e0e-66c74dba69d9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5b3bfa5f-2010-4c5a-9e0e-66c74dba69d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:23.326114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:23.327126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:23.328059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 256/511] 10.222.0.90 () {56 vars in 1093 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:23.328660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bfa5f-2010-4c5a-9e0e-66c74dba69d9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.344209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344cd16-9e03-41df-9fb7-01333737f490 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.384806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcae4b-1390-4470-b8e5-1810df419b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.385634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcae4b-1390-4470-b8e5-1810df419b1d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.385923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcae4b-1390-4470-b8e5-1810df419b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.386214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcae4b-1390-4470-b8e5-1810df419b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.398158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcae4b-1390-4470-b8e5-1810df419b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.399615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcae4b-1390-4470-b8e5-1810df419b1d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1afcae4b-1390-4470-b8e5-1810df419b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:23.419363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:23.421215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:23.422585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:23.422585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:23.422585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:23.422585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:23.422585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 256/512] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:23.425601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcae4b-1390-4470-b8e5-1810df419b1d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.448563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bfa5f-2010-4c5a-9e0e-66c74dba69d9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.494755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d787-2d29-4d1d-b951-331ecf860819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.495555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d787-2d29-4d1d-b951-331ecf860819 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.495837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d787-2d29-4d1d-b951-331ecf860819 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.496111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d787-2d29-4d1d-b951-331ecf860819 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.504717 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056d787-2d29-4d1d-b951-331ecf860819 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.506233 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056d787-2d29-4d1d-b951-331ecf860819 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5056d787-2d29-4d1d-b951-331ecf860819 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:23.523633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:23.524649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 257/513] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:23.525639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d787-2d29-4d1d-b951-331ecf860819 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.531479 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:23.540162 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcae4b-1390-4470-b8e5-1810df419b1d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.592150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:23.593378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a158-9787-497b-83c0-6d7b0402ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.594207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a158-9787-497b-83c0-6d7b0402ee02 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.594495 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a158-9787-497b-83c0-6d7b0402ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.594769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884a158-9787-497b-83c0-6d7b0402ee02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.603196 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884a158-9787-497b-83c0-6d7b0402ee02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.604806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884a158-9787-497b-83c0-6d7b0402ee02 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e884a158-9787-497b-83c0-6d7b0402ee02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:23.620417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:23.621358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 257/514] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:23.627922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a158-9787-497b-83c0-6d7b0402ee02 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.648292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d787-2d29-4d1d-b951-331ecf860819 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.687836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae5245-2c19-4caa-b751-26d5eb8d6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.688505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae5245-2c19-4caa-b751-26d5eb8d6888 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.688797 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae5245-2c19-4caa-b751-26d5eb8d6888 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.689076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae5245-2c19-4caa-b751-26d5eb8d6888 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.689865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae5245-2c19-4caa-b751-26d5eb8d6888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:23.690368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae5245-2c19-4caa-b751-26d5eb8d6888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.691848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae5245-2c19-4caa-b751-26d5eb8d6888 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.704018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 258/515] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:23.705060 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae5245-2c19-4caa-b751-26d5eb8d6888 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.733909 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884a158-9787-497b-83c0-6d7b0402ee02 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.772335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b2e3e-9e14-4f8f-bb5b-38606001ed7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.773017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2e3e-9e14-4f8f-bb5b-38606001ed7d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.773305 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2e3e-9e14-4f8f-bb5b-38606001ed7d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.773627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2e3e-9e14-4f8f-bb5b-38606001ed7d None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.774476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b2e3e-9e14-4f8f-bb5b-38606001ed7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:23.775062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b2e3e-9e14-4f8f-bb5b-38606001ed7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.776303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b2e3e-9e14-4f8f-bb5b-38606001ed7d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.815283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae5245-2c19-4caa-b751-26d5eb8d6888 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.829761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 258/516] 10.222.0.90 () {56 vars in 1133 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:23.829761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b2e3e-9e14-4f8f-bb5b-38606001ed7d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.833932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:23.846147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:23.858801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c77e4-1521-41ed-b335-902523a7018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.859711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c77e4-1521-41ed-b335-902523a7018e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.859998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c77e4-1521-41ed-b335-902523a7018e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.860285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c77e4-1521-41ed-b335-902523a7018e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.861010 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c77e4-1521-41ed-b335-902523a7018e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:23.861324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c77e4-1521-41ed-b335-902523a7018e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.862772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c77e4-1521-41ed-b335-902523a7018e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:23.875694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 259/517] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:23.876524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c77e4-1521-41ed-b335-902523a7018e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:23.947995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b2e3e-9e14-4f8f-bb5b-38606001ed7d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.985273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c77e4-1521-41ed-b335-902523a7018e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:23.987013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f984ad7-695c-4672-80b4-1b5220c41e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:23.987682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f984ad7-695c-4672-80b4-1b5220c41e33 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:23.987961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f984ad7-695c-4672-80b4-1b5220c41e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:23.988237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f984ad7-695c-4672-80b4-1b5220c41e33 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:23.989084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f984ad7-695c-4672-80b4-1b5220c41e33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:23.989383 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f984ad7-695c-4672-80b4-1b5220c41e33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:23.990838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f984ad7-695c-4672-80b4-1b5220c41e33 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:24.011086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 259/518] 10.222.0.90 () {56 vars in 1137 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:24.011916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f984ad7-695c-4672-80b4-1b5220c41e33 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:24.032667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ad96a-7ae1-4f94-945e-f7983ddb7362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:24.033253 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ad96a-7ae1-4f94-945e-f7983ddb7362 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:24.033567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ad96a-7ae1-4f94-945e-f7983ddb7362 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:24.033843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ad96a-7ae1-4f94-945e-f7983ddb7362 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:24.034636 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ad96a-7ae1-4f94-945e-f7983ddb7362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:24.034940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ad96a-7ae1-4f94-945e-f7983ddb7362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:24.036382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ad96a-7ae1-4f94-945e-f7983ddb7362 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:24.054866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 260/519] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:24.055708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ad96a-7ae1-4f94-945e-f7983ddb7362 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:24.092257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:24.092460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:24.128654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f984ad7-695c-4672-80b4-1b5220c41e33 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:24.162979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d6a33-41da-4306-bc9f-801dc97736b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:24.163634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6a33-41da-4306-bc9f-801dc97736b4 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:24.163928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6a33-41da-4306-bc9f-801dc97736b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:24.164213 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6a33-41da-4306-bc9f-801dc97736b4 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:24.164922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d6a33-41da-4306-bc9f-801dc97736b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:24.166389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d6a33-41da-4306-bc9f-801dc97736b4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:24.187810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ad96a-7ae1-4f94-945e-f7983ddb7362 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:24.188364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 260/520] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:00:24 2022] POST /identity/v3/users => generated 247 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:00:24.189203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d6a33-41da-4306-bc9f-801dc97736b4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:24.245239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a26bd-9235-48eb-9dc3-c02e05f23d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:24.246276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a26bd-9235-48eb-9dc3-c02e05f23d26 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:24.246770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a26bd-9235-48eb-9dc3-c02e05f23d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:24.247259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a26bd-9235-48eb-9dc3-c02e05f23d26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:24.333535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d6a33-41da-4306-bc9f-801dc97736b4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:24.352070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a26bd-9235-48eb-9dc3-c02e05f23d26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:24.353589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a26bd-9235-48eb-9dc3-c02e05f23d26 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:24.370326 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:24.382466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7931-5d9b-41b4-b754-7a1213bbab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:24.384797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7931-5d9b-41b4-b754-7a1213bbab52 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:24.384797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7931-5d9b-41b4-b754-7a1213bbab52 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:24.384797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7931-5d9b-41b4-b754-7a1213bbab52 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:24.396431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:24.398356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc7931-5d9b-41b4-b754-7a1213bbab52 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:24.399880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc7931-5d9b-41b4-b754-7a1213bbab52 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-acfc7931-5d9b-41b4-b754-7a1213bbab52 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:24.418697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:24.420847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:00:24.421821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:24.425228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 261/521] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:24.426222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7931-5d9b-41b4-b754-7a1213bbab52 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:24.491326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 261/522] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:24.492187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a26bd-9235-48eb-9dc3-c02e05f23d26 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:24.553174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7931-5d9b-41b4-b754-7a1213bbab52 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:24.598548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676ddc0-672d-49c2-803a-bf32c48e4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:24.599122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676ddc0-672d-49c2-803a-bf32c48e4f01 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:24.599412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676ddc0-672d-49c2-803a-bf32c48e4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:24.599757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676ddc0-672d-49c2-803a-bf32c48e4f01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:24.623133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a26bd-9235-48eb-9dc3-c02e05f23d26 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:24.660102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:24.665429 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b441a6-1825-4fa5-bf1c-d0abee3fc685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:24.666110 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b441a6-1825-4fa5-bf1c-d0abee3fc685 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:24.666393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b441a6-1825-4fa5-bf1c-d0abee3fc685 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:24.666669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b441a6-1825-4fa5-bf1c-d0abee3fc685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:24.667501 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b441a6-1825-4fa5-bf1c-d0abee3fc685 None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=b480c19eb6ec42979a81ad274acb1f40) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:24.667812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b441a6-1825-4fa5-bf1c-d0abee3fc685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:24.670119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b441a6-1825-4fa5-bf1c-d0abee3fc685 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:24.670787 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:24.676460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 262/523] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:24 2022] GET /identity/v3/role_assignments?user.id=b480c19eb6ec42979a81ad274acb1f40&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:24.677332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b441a6-1825-4fa5-bf1c-d0abee3fc685 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:24.705594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676ddc0-672d-49c2-803a-bf32c48e4f01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:24.707949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676ddc0-672d-49c2-803a-bf32c48e4f01 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:24.837460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b441a6-1825-4fa5-bf1c-d0abee3fc685 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:24.870909 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 262/524] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:24.873713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676ddc0-672d-49c2-803a-bf32c48e4f01 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:24.884643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783eff9-9b97-4586-8410-fdd5a409b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:24.885767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783eff9-9b97-4586-8410-fdd5a409b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:24.885767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783eff9-9b97-4586-8410-fdd5a409b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:24.885955 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783eff9-9b97-4586-8410-fdd5a409b2a4 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:24.886802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783eff9-9b97-4586-8410-fdd5a409b2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:24.887109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783eff9-9b97-4586-8410-fdd5a409b2a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:24.889403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783eff9-9b97-4586-8410-fdd5a409b2a4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:24.913099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 263/525] 10.222.0.90 () {56 vars in 1139 bytes} [Tue Jun 21 15:00:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:24.914084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783eff9-9b97-4586-8410-fdd5a409b2a4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:24.992276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:25.001716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:25.020291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676ddc0-672d-49c2-803a-bf32c48e4f01 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:25.053128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783eff9-9b97-4586-8410-fdd5a409b2a4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:25.070235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e849c-1967-478f-ac30-412f24915017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:25.072100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e849c-1967-478f-ac30-412f24915017 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:25.072561 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e849c-1967-478f-ac30-412f24915017 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:25.073027 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e849c-1967-478f-ac30-412f24915017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:25.088049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e849c-1967-478f-ac30-412f24915017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:25.089552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e849c-1967-478f-ac30-412f24915017 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:25.098814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f542e4-9c46-4d48-8a87-b0e418e8a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:25.100538 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f542e4-9c46-4d48-8a87-b0e418e8a240 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:25.101069 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f542e4-9c46-4d48-8a87-b0e418e8a240 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:25.101503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f542e4-9c46-4d48-8a87-b0e418e8a240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-287e849c-1967-478f-ac30-412f24915017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:25.109440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:25.110557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:25.111610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:25.111610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:25.111610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:25.111610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:25.113235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 263/526] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:25.114157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e849c-1967-478f-ac30-412f24915017 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:25.116021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f542e4-9c46-4d48-8a87-b0e418e8a240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:25.117860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f542e4-9c46-4d48-8a87-b0e418e8a240 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-68f542e4-9c46-4d48-8a87-b0e418e8a240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:25.142548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:25.143673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:25.144648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:25.144648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:25.144648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:25.144648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:25.147056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 264/527] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:25.148418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f542e4-9c46-4d48-8a87-b0e418e8a240 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:25.233724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e849c-1967-478f-ac30-412f24915017 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:25.271644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcdca8-8c38-4bc3-83fd-75fd382e6492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:25.272458 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcdca8-8c38-4bc3-83fd-75fd382e6492 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:25.272848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcdca8-8c38-4bc3-83fd-75fd382e6492 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:25.273224 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcdca8-8c38-4bc3-83fd-75fd382e6492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:25.276861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f542e4-9c46-4d48-8a87-b0e418e8a240 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:25.289286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:25.289824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:25.323586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791aa88-5146-4049-907c-88d2568dcf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:25.324611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791aa88-5146-4049-907c-88d2568dcf00 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:25.326272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791aa88-5146-4049-907c-88d2568dcf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:25.326272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791aa88-5146-4049-907c-88d2568dcf00 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:25.326272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791aa88-5146-4049-907c-88d2568dcf00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:25.326688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791aa88-5146-4049-907c-88d2568dcf00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:25.328486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791aa88-5146-4049-907c-88d2568dcf00 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:25.346273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 265/528] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:25.347363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791aa88-5146-4049-907c-88d2568dcf00 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:25.370012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcdca8-8c38-4bc3-83fd-75fd382e6492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:25.372102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcdca8-8c38-4bc3-83fd-75fd382e6492 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:25.476034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791aa88-5146-4049-907c-88d2568dcf00 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:25.514231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 264/529] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:25.515632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcdca8-8c38-4bc3-83fd-75fd382e6492 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:25.518467 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cd3af-afa9-46dc-94ab-b6d2bc76d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:25.519433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cd3af-afa9-46dc-94ab-b6d2bc76d148 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:25.519937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cd3af-afa9-46dc-94ab-b6d2bc76d148 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:25.520424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cd3af-afa9-46dc-94ab-b6d2bc76d148 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:25.521354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cd3af-afa9-46dc-94ab-b6d2bc76d148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:25.521889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cd3af-afa9-46dc-94ab-b6d2bc76d148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:25.523479 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cd3af-afa9-46dc-94ab-b6d2bc76d148 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:25.539071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 266/530] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:25.540290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cd3af-afa9-46dc-94ab-b6d2bc76d148 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:25.574847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:25.584032 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:25.655731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcdca8-8c38-4bc3-83fd-75fd382e6492 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:25.665654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cd3af-afa9-46dc-94ab-b6d2bc76d148 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:25.692397 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1fa04-27e7-457b-91d7-f0c9b2433afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:25.693194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1fa04-27e7-457b-91d7-f0c9b2433afb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:25.693493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1fa04-27e7-457b-91d7-f0c9b2433afb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:25.694005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1fa04-27e7-457b-91d7-f0c9b2433afb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:25.701096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1fa04-27e7-457b-91d7-f0c9b2433afb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:25.702606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1fa04-27e7-457b-91d7-f0c9b2433afb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:25.706528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11644a3f-5cf1-4804-b179-f2fcdf9f8e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:25.707626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644a3f-5cf1-4804-b179-f2fcdf9f8e0f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:25.708134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644a3f-5cf1-4804-b179-f2fcdf9f8e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:25.708615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11644a3f-5cf1-4804-b179-f2fcdf9f8e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-11f1fa04-27e7-457b-91d7-f0c9b2433afb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:25.717709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:25.718621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:25.719503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:25.719503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:25.719503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:25.719503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:25.719503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:25.719503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:25.719503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:25.719503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:25.719503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 265/531] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:25.719984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1fa04-27e7-457b-91d7-f0c9b2433afb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:25.724313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11644a3f-5cf1-4804-b179-f2fcdf9f8e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:25.726207 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11644a3f-5cf1-4804-b179-f2fcdf9f8e0f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-11644a3f-5cf1-4804-b179-f2fcdf9f8e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:25.745297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:25.746326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:25.747851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:25.747851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:25.747851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:25.747851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:25.750305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 267/532] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:25.751353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11644a3f-5cf1-4804-b179-f2fcdf9f8e0f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:25.830516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:25.835432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1fa04-27e7-457b-91d7-f0c9b2433afb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:25.867068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:25.876688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff128ef-8b72-463b-b48c-532a25eaf3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:25.877512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff128ef-8b72-463b-b48c-532a25eaf3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:25.877803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff128ef-8b72-463b-b48c-532a25eaf3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:25.878082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff128ef-8b72-463b-b48c-532a25eaf3c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:25.885740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff128ef-8b72-463b-b48c-532a25eaf3c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:25.887342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff128ef-8b72-463b-b48c-532a25eaf3c7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9ff128ef-8b72-463b-b48c-532a25eaf3c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:25.904401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:25.905877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:25.907539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:25.907539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:25.907539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:25.907539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:25.907539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:25.907539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:25.907539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:25.907539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:25.908733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11644a3f-5cf1-4804-b179-f2fcdf9f8e0f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:25.909729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 266/533] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:25.910725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff128ef-8b72-463b-b48c-532a25eaf3c7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:25.967616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd7220-497e-46d6-a283-de7ae6feeefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:25.968956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd7220-497e-46d6-a283-de7ae6feeefa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:25.969627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd7220-497e-46d6-a283-de7ae6feeefa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:25.970287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd7220-497e-46d6-a283-de7ae6feeefa None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:25.971814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd7220-497e-46d6-a283-de7ae6feeefa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:25.972518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd7220-497e-46d6-a283-de7ae6feeefa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:25.975207 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd7220-497e-46d6-a283-de7ae6feeefa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:25.995797 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 268/534] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:25.997433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd7220-497e-46d6-a283-de7ae6feeefa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:26.034478 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff128ef-8b72-463b-b48c-532a25eaf3c7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:26.075644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30935749-bf94-45aa-8625-639c81b3ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:26.076800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30935749-bf94-45aa-8625-639c81b3ca71 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:26.077254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30935749-bf94-45aa-8625-639c81b3ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:26.077718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30935749-bf94-45aa-8625-639c81b3ca71 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:26.078910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30935749-bf94-45aa-8625-639c81b3ca71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:26.079415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30935749-bf94-45aa-8625-639c81b3ca71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:26.082242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30935749-bf94-45aa-8625-639c81b3ca71 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:26.099923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 267/535] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:26.100822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30935749-bf94-45aa-8625-639c81b3ca71 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:26.120512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd7220-497e-46d6-a283-de7ae6feeefa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:26.123561 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:26.158591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123edc-7a3e-4852-93fc-1d095e13dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:26.159538 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123edc-7a3e-4852-93fc-1d095e13dc8c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:26.159985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123edc-7a3e-4852-93fc-1d095e13dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:26.160428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123edc-7a3e-4852-93fc-1d095e13dc8c None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:26.161623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85123edc-7a3e-4852-93fc-1d095e13dc8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:26.162464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85123edc-7a3e-4852-93fc-1d095e13dc8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:26.167243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85123edc-7a3e-4852-93fc-1d095e13dc8c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:26.177346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:26.183214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 269/536] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:26.185190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123edc-7a3e-4852-93fc-1d095e13dc8c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:26.228747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30935749-bf94-45aa-8625-639c81b3ca71 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:26.268315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77808380-7e21-45e7-9a3c-390592601e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:26.269554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77808380-7e21-45e7-9a3c-390592601e46 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:26.269846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77808380-7e21-45e7-9a3c-390592601e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:26.270127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77808380-7e21-45e7-9a3c-390592601e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:26.271640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77808380-7e21-45e7-9a3c-390592601e46 None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=2bd3ffc0a30648139b2cbf19bb6bd535) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:26.271962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77808380-7e21-45e7-9a3c-390592601e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:26.274824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77808380-7e21-45e7-9a3c-390592601e46 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:26.282237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 268/537] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:26 2022] GET /identity/v3/role_assignments?user.id=2bd3ffc0a30648139b2cbf19bb6bd535&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:26.283091 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77808380-7e21-45e7-9a3c-390592601e46 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:26.341741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123edc-7a3e-4852-93fc-1d095e13dc8c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:26.410870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa08e3-2d1f-47fc-a993-bfc6d7b6a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:26.412067 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa08e3-2d1f-47fc-a993-bfc6d7b6a7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:26.412523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa08e3-2d1f-47fc-a993-bfc6d7b6a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:26.412946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa08e3-2d1f-47fc-a993-bfc6d7b6a7a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:26.425785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa08e3-2d1f-47fc-a993-bfc6d7b6a7a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:26.428711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa08e3-2d1f-47fc-a993-bfc6d7b6a7a3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fafa08e3-2d1f-47fc-a993-bfc6d7b6a7a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:26.450771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:26.453055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:26.455185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:26.455185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:26.455185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:26.455185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:26.455185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:26.455185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:26.455185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:26.455185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:26.455185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 270/538] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:26.462872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa08e3-2d1f-47fc-a993-bfc6d7b6a7a3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:26.470258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:26.517884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77808380-7e21-45e7-9a3c-390592601e46 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:26.585964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dfb19-b13c-4a68-8866-d905bfc10b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:26.586525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dfb19-b13c-4a68-8866-d905bfc10b93 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:26.586807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dfb19-b13c-4a68-8866-d905bfc10b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:26.587086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dfb19-b13c-4a68-8866-d905bfc10b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:26.587925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dfb19-b13c-4a68-8866-d905bfc10b93 None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=27ac2738bf434afabe3d227dc5e52650) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:26.588237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dfb19-b13c-4a68-8866-d905bfc10b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:26.589712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dfb19-b13c-4a68-8866-d905bfc10b93 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:26.595885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:26.598022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 269/539] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:26 2022] GET /identity/v3/role_assignments?user.id=27ac2738bf434afabe3d227dc5e52650&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:26.649709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b35a8-2548-44c8-8704-18fb9179561b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:26.650047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b35a8-2548-44c8-8704-18fb9179561b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:26.650469 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b35a8-2548-44c8-8704-18fb9179561b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:26.653726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 270/540] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:00:26.662069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c36ad0-6a07-4d64-82b3-b9772dff2420 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:26.662517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c36ad0-6a07-4d64-82b3-b9772dff2420 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:26.662923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c36ad0-6a07-4d64-82b3-b9772dff2420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:26.664522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa08e3-2d1f-47fc-a993-bfc6d7b6a7a3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:26.702696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c3c36ad0-6a07-4d64-82b3-b9772dff2420 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:26.703985 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3c36ad0-6a07-4d64-82b3-b9772dff2420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:26.744721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ec9d4-dfbd-49cb-8168-8b2edd3d2932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:26.745392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ec9d4-dfbd-49cb-8168-8b2edd3d2932 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:26.745699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ec9d4-dfbd-49cb-8168-8b2edd3d2932 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:26.746114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ec9d4-dfbd-49cb-8168-8b2edd3d2932 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:26.747550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ec9d4-dfbd-49cb-8168-8b2edd3d2932 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:26.747875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ec9d4-dfbd-49cb-8168-8b2edd3d2932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:26.749490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ec9d4-dfbd-49cb-8168-8b2edd3d2932 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:26.771833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 271/541] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:26.782867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ec9d4-dfbd-49cb-8168-8b2edd3d2932 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:26.827991 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 271/542] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:00:26.880141 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c36ad0-6a07-4d64-82b3-b9772dff2420 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:26.980803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ec9d4-dfbd-49cb-8168-8b2edd3d2932 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:27.007400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:27.021953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:27.037849 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c36ad0-6a07-4d64-82b3-b9772dff2420 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:27.044509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc61e34-802b-4a72-ad02-8d25fff27eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:27.045187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc61e34-802b-4a72-ad02-8d25fff27eef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:27.045496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc61e34-802b-4a72-ad02-8d25fff27eef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:27.045774 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc61e34-802b-4a72-ad02-8d25fff27eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:27.046803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc61e34-802b-4a72-ad02-8d25fff27eef None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=08b3093a7415419cbb6d50701b09b7e8) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:27.047120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc61e34-802b-4a72-ad02-8d25fff27eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:27.048571 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc61e34-802b-4a72-ad02-8d25fff27eef None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:27.069636 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 272/543] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:26 2022] GET /identity/v3/role_assignments?user.id=08b3093a7415419cbb6d50701b09b7e8&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:27.102831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9d6ab-600c-46ac-80ab-0d05bd5e89fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:27.104568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9d6ab-600c-46ac-80ab-0d05bd5e89fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:27.105299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9d6ab-600c-46ac-80ab-0d05bd5e89fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:27.114254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9d6ab-600c-46ac-80ab-0d05bd5e89fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:27.133565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9d6ab-600c-46ac-80ab-0d05bd5e89fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9ad9d6ab-600c-46ac-80ab-0d05bd5e89fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:27.148572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:27.150114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:27.151415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:27.155978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 272/544] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:27.165672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc61e34-802b-4a72-ad02-8d25fff27eef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:27.183562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadecbb-20a9-472c-a67f-063dec965491 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:27.184291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadecbb-20a9-472c-a67f-063dec965491 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:27.184810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadecbb-20a9-472c-a67f-063dec965491 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:27.186932 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 273/545] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:00:27.192989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b56b17-8831-4608-8320-6149477dd0c7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:27.193658 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b56b17-8831-4608-8320-6149477dd0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:27.194180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b56b17-8831-4608-8320-6149477dd0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:27.213227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-45b56b17-8831-4608-8320-6149477dd0c7 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:27.214930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45b56b17-8831-4608-8320-6149477dd0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:27.302875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 274/546] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:00:27.359581 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc61e34-802b-4a72-ad02-8d25fff27eef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:27.372403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b56b17-8831-4608-8320-6149477dd0c7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:27.400602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fb791-f1d6-402c-beee-4f6e98bae257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:27.401672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb791-f1d6-402c-beee-4f6e98bae257 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:27.402179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb791-f1d6-402c-beee-4f6e98bae257 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:27.402710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb791-f1d6-402c-beee-4f6e98bae257 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:27.404438 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fb791-f1d6-402c-beee-4f6e98bae257 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:27.405019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fb791-f1d6-402c-beee-4f6e98bae257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:27.406673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fb791-f1d6-402c-beee-4f6e98bae257 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:27.416109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 273/547] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:27.422632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fb791-f1d6-402c-beee-4f6e98bae257 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:27.470852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:27.511107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b56b17-8831-4608-8320-6149477dd0c7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:27.557849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:27.562229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb34eab-555a-4d52-8811-6981c113a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:27.563047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb34eab-555a-4d52-8811-6981c113a115 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:27.563327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb34eab-555a-4d52-8811-6981c113a115 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:27.563603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb34eab-555a-4d52-8811-6981c113a115 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:27.591599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb34eab-555a-4d52-8811-6981c113a115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6bb34eab-555a-4d52-8811-6981c113a115 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:27.603554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:27.604528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:27.605349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 275/548] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:27.619712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb34eab-555a-4d52-8811-6981c113a115 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:27.676908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fb791-f1d6-402c-beee-4f6e98bae257 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:27.786276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4f20-2cd0-4ca2-bb0a-6723c1ac0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:27.787106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4f20-2cd0-4ca2-bb0a-6723c1ac0026 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:27.787390 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4f20-2cd0-4ca2-bb0a-6723c1ac0026 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:27.789236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4f20-2cd0-4ca2-bb0a-6723c1ac0026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:27.825175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb34eab-555a-4d52-8811-6981c113a115 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:27.837033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e4f20-2cd0-4ca2-bb0a-6723c1ac0026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:27.839426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e4f20-2cd0-4ca2-bb0a-6723c1ac0026 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:27.849986 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:27.862804 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f98473-55bd-40bc-8077-89ca18480215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:27.863908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98473-55bd-40bc-8077-89ca18480215 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:27.864367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98473-55bd-40bc-8077-89ca18480215 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:27.864806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98473-55bd-40bc-8077-89ca18480215 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:27.866002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98473-55bd-40bc-8077-89ca18480215 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:27.866462 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98473-55bd-40bc-8077-89ca18480215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:27.867905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98473-55bd-40bc-8077-89ca18480215 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:27.878067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 276/549] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6b5e4f20-2cd0-4ca2-bb0a-6723c1ac0026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:27.899002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:27.900322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:27.901677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:27.901677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:27.901677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:27.901677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:27.901677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 274/550] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:27.902324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f98473-55bd-40bc-8077-89ca18480215 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:27.907520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4f20-2cd0-4ca2-bb0a-6723c1ac0026 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:28.072088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f98473-55bd-40bc-8077-89ca18480215 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:28.119820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:28.136925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4f20-2cd0-4ca2-bb0a-6723c1ac0026 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:28.175576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb929e-7da3-467f-a808-f586c8d6446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:28.176774 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb929e-7da3-467f-a808-f586c8d6446c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:28.177062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb929e-7da3-467f-a808-f586c8d6446c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:28.177337 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb929e-7da3-467f-a808-f586c8d6446c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:28.182244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebf6d4-dc80-4df2-be3f-19ba8dd619e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:28.182917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebf6d4-dc80-4df2-be3f-19ba8dd619e8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:28.183414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebf6d4-dc80-4df2-be3f-19ba8dd619e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:28.183699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebf6d4-dc80-4df2-be3f-19ba8dd619e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:28.184859 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebf6d4-dc80-4df2-be3f-19ba8dd619e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:28.185093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebf6d4-dc80-4df2-be3f-19ba8dd619e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:28.186833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebf6d4-dc80-4df2-be3f-19ba8dd619e8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:28.202978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 275/551] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:28.207424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb929e-7da3-467f-a808-f586c8d6446c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:28.207424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb929e-7da3-467f-a808-f586c8d6446c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:28.208592 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebf6d4-dc80-4df2-be3f-19ba8dd619e8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-91cb929e-7da3-467f-a808-f586c8d6446c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:28.253239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:28.254487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:28.255568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:28.255568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:28.255568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:28.255568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:28.255800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 277/552] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:28.263055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb929e-7da3-467f-a808-f586c8d6446c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:28.365523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:28.411934 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebf6d4-dc80-4df2-be3f-19ba8dd619e8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:28.496313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb929e-7da3-467f-a808-f586c8d6446c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:28.499850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e82c-d59b-4254-9b11-008516db7ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:28.501072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e82c-d59b-4254-9b11-008516db7ceb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:28.501531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e82c-d59b-4254-9b11-008516db7ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:28.501950 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e82c-d59b-4254-9b11-008516db7ceb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:28.539299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605e82c-d59b-4254-9b11-008516db7ceb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:28.542022 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605e82c-d59b-4254-9b11-008516db7ceb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1605e82c-d59b-4254-9b11-008516db7ceb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:28.572167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:28.573196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:28.574175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:28.579923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 276/553] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:28.581949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e82c-d59b-4254-9b11-008516db7ceb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:28.583647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d717d-b0cf-41c4-b405-74bb9342c0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:28.584499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d717d-b0cf-41c4-b405-74bb9342c0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:28.584938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d717d-b0cf-41c4-b405-74bb9342c0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:28.585368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d717d-b0cf-41c4-b405-74bb9342c0f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:28.586677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d717d-b0cf-41c4-b405-74bb9342c0f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:28.587154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d717d-b0cf-41c4-b405-74bb9342c0f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:28.588691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d717d-b0cf-41c4-b405-74bb9342c0f4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:28.614652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 278/554] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:28.619450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d717d-b0cf-41c4-b405-74bb9342c0f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:28.628546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:28.751260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d717d-b0cf-41c4-b405-74bb9342c0f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:28.769860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:28.804460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f345ae2-3b51-4263-ac7c-ed0641568135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:28.805587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f345ae2-3b51-4263-ac7c-ed0641568135 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:28.806017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f345ae2-3b51-4263-ac7c-ed0641568135 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:28.806463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f345ae2-3b51-4263-ac7c-ed0641568135 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:28.824227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f345ae2-3b51-4263-ac7c-ed0641568135 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:28.826764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f345ae2-3b51-4263-ac7c-ed0641568135 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:28.849062 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e82c-d59b-4254-9b11-008516db7ceb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7f345ae2-3b51-4263-ac7c-ed0641568135 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:28.859365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:28.860559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:00:28.862268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:28.869919 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 279/555] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:28.876540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f345ae2-3b51-4263-ac7c-ed0641568135 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:29.004526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f345ae2-3b51-4263-ac7c-ed0641568135 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:29.010508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22359d9f-62d5-4995-bcf1-d36b54d34f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:29.011585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22359d9f-62d5-4995-bcf1-d36b54d34f0c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.012114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22359d9f-62d5-4995-bcf1-d36b54d34f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.013082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22359d9f-62d5-4995-bcf1-d36b54d34f0c None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.014351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22359d9f-62d5-4995-bcf1-d36b54d34f0c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:29.014670 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22359d9f-62d5-4995-bcf1-d36b54d34f0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:29.016141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22359d9f-62d5-4995-bcf1-d36b54d34f0c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:29.047905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a0142-c62d-43a1-9d10-f56d47f1c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:29.048936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a0142-c62d-43a1-9d10-f56d47f1c73a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.049369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a0142-c62d-43a1-9d10-f56d47f1c73a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.049834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a0142-c62d-43a1-9d10-f56d47f1c73a None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.050903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a0142-c62d-43a1-9d10-f56d47f1c73a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:29.051382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a0142-c62d-43a1-9d10-f56d47f1c73a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:29.051712 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 277/556] 10.222.0.90 () {56 vars in 1135 bytes} [Tue Jun 21 15:00:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:29.053169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a0142-c62d-43a1-9d10-f56d47f1c73a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:29.053299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488126a3-7d8a-4309-bae0-9627a131f293 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.053523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488126a3-7d8a-4309-bae0-9627a131f293 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.053807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488126a3-7d8a-4309-bae0-9627a131f293 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.055437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 278/557] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:29.056149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488126a3-7d8a-4309-bae0-9627a131f293 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:29.078210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 280/558] 10.222.0.90 () {56 vars in 1137 bytes} [Tue Jun 21 15:00:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:29.080701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a8fd-bc97-4e34-a9ab-6ab552df957d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.081158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a8fd-bc97-4e34-a9ab-6ab552df957d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.081858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a8fd-bc97-4e34-a9ab-6ab552df957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.104786 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fb63a8fd-bc97-4e34-a9ab-6ab552df957d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:29.109055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fb63a8fd-bc97-4e34-a9ab-6ab552df957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:29.134136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:29.166745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:29.197543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 281/559] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:29.198650 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63a8fd-bc97-4e34-a9ab-6ab552df957d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:29.214287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488126a3-7d8a-4309-bae0-9627a131f293 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:29.274151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e36ea-4d11-4d0a-b541-ae23116cf5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:29.274742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e36ea-4d11-4d0a-b541-ae23116cf5db None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.275058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e36ea-4d11-4d0a-b541-ae23116cf5db None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.275339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e36ea-4d11-4d0a-b541-ae23116cf5db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.323648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63a8fd-bc97-4e34-a9ab-6ab552df957d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:29.358982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e36ea-4d11-4d0a-b541-ae23116cf5db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:29.360516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e36ea-4d11-4d0a-b541-ae23116cf5db None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:29.364516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f7c2a-a5ce-4010-91cb-c5f3f63cd74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:29.366241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f7c2a-a5ce-4010-91cb-c5f3f63cd74e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.366811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f7c2a-a5ce-4010-91cb-c5f3f63cd74e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.367076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f7c2a-a5ce-4010-91cb-c5f3f63cd74e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.383180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f7c2a-a5ce-4010-91cb-c5f3f63cd74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:29.385493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f7c2a-a5ce-4010-91cb-c5f3f63cd74e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:29.399777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c02f7c2a-a5ce-4010-91cb-c5f3f63cd74e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:29.412513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:29.413520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:29.414456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:29.414456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:29.414456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:29.414456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:29.414456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 282/560] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:29.415317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4972-1048-4102-901b-6818c556d350 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.415431 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4972-1048-4102-901b-6818c556d350 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.415698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4972-1048-4102-901b-6818c556d350 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.421446 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 283/561] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:29.422522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4972-1048-4102-901b-6818c556d350 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:29.453359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:29.485519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 279/562] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:29.487377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e36ea-4d11-4d0a-b541-ae23116cf5db None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:29.546116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4972-1048-4102-901b-6818c556d350 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:29.599859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b9388-a010-403b-9077-ac813fcd27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:29.600677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9388-a010-403b-9077-ac813fcd27d3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.600960 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9388-a010-403b-9077-ac813fcd27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.601240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9388-a010-403b-9077-ac813fcd27d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.619950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b9388-a010-403b-9077-ac813fcd27d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-292b9388-a010-403b-9077-ac813fcd27d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:29.628072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:29.629577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:29.630691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 284/563] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:29.631541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f8a52-3681-46d0-b1dc-e796958c6395 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.631541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f8a52-3681-46d0-b1dc-e796958c6395 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.631707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f8a52-3681-46d0-b1dc-e796958c6395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.647354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e36ea-4d11-4d0a-b541-ae23116cf5db None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:29.651553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7a7f8a52-3681-46d0-b1dc-e796958c6395 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:29.653322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7a7f8a52-3681-46d0-b1dc-e796958c6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:29.688405 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce6411-bb0a-475a-b8b2-60540d4cf39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:29.689077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce6411-bb0a-475a-b8b2-60540d4cf39a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.689368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce6411-bb0a-475a-b8b2-60540d4cf39a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.689675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce6411-bb0a-475a-b8b2-60540d4cf39a None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.690400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce6411-bb0a-475a-b8b2-60540d4cf39a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:29.690708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce6411-bb0a-475a-b8b2-60540d4cf39a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:29.692091 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce6411-bb0a-475a-b8b2-60540d4cf39a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:29.705536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 280/564] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:29.706278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce6411-bb0a-475a-b8b2-60540d4cf39a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:29.716639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:29.728637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 285/565] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:29.729846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f8a52-3681-46d0-b1dc-e796958c6395 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:29.747493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:29.824937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce6411-bb0a-475a-b8b2-60540d4cf39a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:29.845348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f8a52-3681-46d0-b1dc-e796958c6395 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:29.863809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da98e-db34-4590-819e-bba055cd2faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:29.864597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da98e-db34-4590-819e-bba055cd2faf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.864886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da98e-db34-4590-819e-bba055cd2faf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.865161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da98e-db34-4590-819e-bba055cd2faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.876087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451da98e-db34-4590-819e-bba055cd2faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:29.877605 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451da98e-db34-4590-819e-bba055cd2faf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:29.879749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8297d63-a4fb-4b92-826d-8ac7fbe6bcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:29.880474 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8297d63-a4fb-4b92-826d-8ac7fbe6bcbe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.880767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8297d63-a4fb-4b92-826d-8ac7fbe6bcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.881048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8297d63-a4fb-4b92-826d-8ac7fbe6bcbe None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.881853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8297d63-a4fb-4b92-826d-8ac7fbe6bcbe None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:29.882165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8297d63-a4fb-4b92-826d-8ac7fbe6bcbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:29.883531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8297d63-a4fb-4b92-826d-8ac7fbe6bcbe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-451da98e-db34-4590-819e-bba055cd2faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:29.897529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:29.899230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:29.900667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:29.900667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:29.900667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:29.900667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:29.900667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 281/566] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:29.900667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489b223-5768-4fd8-a822-94c63eea5369 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:29.901020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489b223-5768-4fd8-a822-94c63eea5369 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:29.901505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489b223-5768-4fd8-a822-94c63eea5369 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:29.903199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 282/567] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:29.903932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489b223-5768-4fd8-a822-94c63eea5369 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:29.907512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 286/568] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:29.908663 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8297d63-a4fb-4b92-826d-8ac7fbe6bcbe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:29.979341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:30.015606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:30.032120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489b223-5768-4fd8-a822-94c63eea5369 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.034831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8297d63-a4fb-4b92-826d-8ac7fbe6bcbe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.071260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c9dfd-4b07-40b9-b519-61eda59e20f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.072544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c9dfd-4b07-40b9-b519-61eda59e20f4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.073015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c9dfd-4b07-40b9-b519-61eda59e20f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.073513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c9dfd-4b07-40b9-b519-61eda59e20f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.075951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f7654-cc9f-4d2f-80e4-7e516ea0979a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.077180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7654-cc9f-4d2f-80e4-7e516ea0979a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.077685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7654-cc9f-4d2f-80e4-7e516ea0979a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.078155 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7654-cc9f-4d2f-80e4-7e516ea0979a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.087938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c9dfd-4b07-40b9-b519-61eda59e20f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:30.090818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c9dfd-4b07-40b9-b519-61eda59e20f4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:30.097413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f7654-cc9f-4d2f-80e4-7e516ea0979a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7f4f7654-cc9f-4d2f-80e4-7e516ea0979a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:30.112220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:30.113368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:30.114419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:30.115158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 287/569] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:30.115864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f7654-cc9f-4d2f-80e4-7e516ea0979a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a00c9dfd-4b07-40b9-b519-61eda59e20f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:30.116122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:30.117012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:30.117940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:30.117940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:30.117940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:30.117940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:30.117940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:30.117940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:30.117940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:30.117940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:30.117940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 283/570] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:30.119528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783c1cb-01b4-473a-b563-0619f3874a1e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.119979 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783c1cb-01b4-473a-b563-0619f3874a1e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.120426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783c1cb-01b4-473a-b563-0619f3874a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.141011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b783c1cb-01b4-473a-b563-0619f3874a1e None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:30.142301 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b783c1cb-01b4-473a-b563-0619f3874a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:30.213283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 284/571] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:30.214152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783c1cb-01b4-473a-b563-0619f3874a1e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:30.230626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f7654-cc9f-4d2f-80e4-7e516ea0979a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.245648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:30.275031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e089ffa-f856-4e4e-90b7-f5f51f464c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.275698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e089ffa-f856-4e4e-90b7-f5f51f464c65 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.275980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e089ffa-f856-4e4e-90b7-f5f51f464c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.276257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e089ffa-f856-4e4e-90b7-f5f51f464c65 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.277028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e089ffa-f856-4e4e-90b7-f5f51f464c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:30.277334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e089ffa-f856-4e4e-90b7-f5f51f464c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:30.279294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e089ffa-f856-4e4e-90b7-f5f51f464c65 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:30.302577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 288/572] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:30.310974 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e089ffa-f856-4e4e-90b7-f5f51f464c65 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:30.317176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:30.343258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783c1cb-01b4-473a-b563-0619f3874a1e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.379320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2d254-d3b6-4415-a29f-4cab23cf1b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.380117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2d254-d3b6-4415-a29f-4cab23cf1b16 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.380554 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2d254-d3b6-4415-a29f-4cab23cf1b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.381038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2d254-d3b6-4415-a29f-4cab23cf1b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.393223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2d254-d3b6-4415-a29f-4cab23cf1b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:30.394748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2d254-d3b6-4415-a29f-4cab23cf1b16 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-85d2d254-d3b6-4415-a29f-4cab23cf1b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:30.415197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:30.416341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:30.417336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:30.417336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:30.417336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:30.417336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:30.417336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 285/573] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:30.417336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2d254-d3b6-4415-a29f-4cab23cf1b16 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:30.429112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e089ffa-f856-4e4e-90b7-f5f51f464c65 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.482328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f51d-9154-4cc0-bfe3-c0fa15871714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.482562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f51d-9154-4cc0-bfe3-c0fa15871714 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.482788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f51d-9154-4cc0-bfe3-c0fa15871714 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.483062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f51d-9154-4cc0-bfe3-c0fa15871714 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.483824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f51d-9154-4cc0-bfe3-c0fa15871714 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:30.484234 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f51d-9154-4cc0-bfe3-c0fa15871714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:30.485576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f51d-9154-4cc0-bfe3-c0fa15871714 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:30.494802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 289/574] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:30.495634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f51d-9154-4cc0-bfe3-c0fa15871714 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:30.539844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:30.549618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2d254-d3b6-4415-a29f-4cab23cf1b16 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.583193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:30.593051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30e31-abe0-49ef-bdf8-efa569ed3646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.594120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30e31-abe0-49ef-bdf8-efa569ed3646 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.594353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30e31-abe0-49ef-bdf8-efa569ed3646 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.594628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30e31-abe0-49ef-bdf8-efa569ed3646 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.595458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30e31-abe0-49ef-bdf8-efa569ed3646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:30.595770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30e31-abe0-49ef-bdf8-efa569ed3646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:30.597205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30e31-abe0-49ef-bdf8-efa569ed3646 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:30.610574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 286/575] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:30.611421 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30e31-abe0-49ef-bdf8-efa569ed3646 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:30.614610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f51d-9154-4cc0-bfe3-c0fa15871714 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.650782 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe5c8-f4d6-41c2-ad10-2fa1429ae949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.652036 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe5c8-f4d6-41c2-ad10-2fa1429ae949 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.652482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe5c8-f4d6-41c2-ad10-2fa1429ae949 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.653568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe5c8-f4d6-41c2-ad10-2fa1429ae949 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.665597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afe5c8-f4d6-41c2-ad10-2fa1429ae949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-01afe5c8-f4d6-41c2-ad10-2fa1429ae949 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:30.674467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:30.675507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 290/576] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:30.677005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe5c8-f4d6-41c2-ad10-2fa1429ae949 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:30.728246 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30e31-abe0-49ef-bdf8-efa569ed3646 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.765974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbb193-0086-4a0a-9059-ac69f2615eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.766776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbb193-0086-4a0a-9059-ac69f2615eee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.767062 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbb193-0086-4a0a-9059-ac69f2615eee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.767350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbb193-0086-4a0a-9059-ac69f2615eee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.774590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbb193-0086-4a0a-9059-ac69f2615eee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:30.776056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbb193-0086-4a0a-9059-ac69f2615eee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:30.776483 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:30.784836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe5c8-f4d6-41c2-ad10-2fa1429ae949 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-efbbb193-0086-4a0a-9059-ac69f2615eee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:30.791751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:30.792701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:30.794612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:30.794612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:30.794612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:30.794612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:30.794612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:30.794612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:30.794612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:30.794612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:30.794612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 287/577] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:30.796097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbb193-0086-4a0a-9059-ac69f2615eee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:30.830952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e2c42-64a8-4bf5-8629-a45909b36496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.832002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e2c42-64a8-4bf5-8629-a45909b36496 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.832469 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e2c42-64a8-4bf5-8629-a45909b36496 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.832886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e2c42-64a8-4bf5-8629-a45909b36496 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.834117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e2c42-64a8-4bf5-8629-a45909b36496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:30.834582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e2c42-64a8-4bf5-8629-a45909b36496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:30.836769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e2c42-64a8-4bf5-8629-a45909b36496 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:30.853367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 291/578] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:30.854470 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e2c42-64a8-4bf5-8629-a45909b36496 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:30.854671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:30.917282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbb193-0086-4a0a-9059-ac69f2615eee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.956316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2536fa-40f8-4031-a7e4-3b9554c5a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:30.957109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2536fa-40f8-4031-a7e4-3b9554c5a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:30.957391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2536fa-40f8-4031-a7e4-3b9554c5a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:30.957704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2536fa-40f8-4031-a7e4-3b9554c5a9c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:30.968351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e2c42-64a8-4bf5-8629-a45909b36496 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:30.969885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2536fa-40f8-4031-a7e4-3b9554c5a9c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:30.972209 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2536fa-40f8-4031-a7e4-3b9554c5a9c8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-de2536fa-40f8-4031-a7e4-3b9554c5a9c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:30.990924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:30.991901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:30.992851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:30.992851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:30.992851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:30.992851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:30.992851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 288/579] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:30.993614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2536fa-40f8-4031-a7e4-3b9554c5a9c8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.015766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba32d8a-0781-4a0a-8df6-bacc5181b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:31.017072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba32d8a-0781-4a0a-8df6-bacc5181b103 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:31.017529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba32d8a-0781-4a0a-8df6-bacc5181b103 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:31.017942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba32d8a-0781-4a0a-8df6-bacc5181b103 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/b480c19eb6ec42979a81ad274acb1f40/roles/ce176ffaea984efb879ec3a4c2da0742` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:31.037350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba32d8a-0781-4a0a-8df6-bacc5181b103 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=b480c19eb6ec42979a81ad274acb1f40, role_id=ce176ffaea984efb879ec3a4c2da0742)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:31.038823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba32d8a-0781-4a0a-8df6-bacc5181b103 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:31.053344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 292/580] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:00:30 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/b480c19eb6ec42979a81ad274acb1f40/roles/ce176ffaea984efb879ec3a4c2da0742 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:31.054497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba32d8a-0781-4a0a-8df6-bacc5181b103 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.059124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:31.117825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:31.121049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2536fa-40f8-4031-a7e4-3b9554c5a9c8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:31.167832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bf117-12a5-49b6-af81-e4ed00f68061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:31.169575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bf117-12a5-49b6-af81-e4ed00f68061 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:31.169872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bf117-12a5-49b6-af81-e4ed00f68061 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:31.170150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bf117-12a5-49b6-af81-e4ed00f68061 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:31.170964 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bf117-12a5-49b6-af81-e4ed00f68061 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:31.171261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bf117-12a5-49b6-af81-e4ed00f68061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:31.172681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bf117-12a5-49b6-af81-e4ed00f68061 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:31.188465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 289/581] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:31.188465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bf117-12a5-49b6-af81-e4ed00f68061 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.192707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba32d8a-0781-4a0a-8df6-bacc5181b103 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:31.235768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9765e-5a6a-49f9-8da9-7938b5cdadcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:31.236453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9765e-5a6a-49f9-8da9-7938b5cdadcc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:31.236743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9765e-5a6a-49f9-8da9-7938b5cdadcc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:31.237031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9765e-5a6a-49f9-8da9-7938b5cdadcc None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:31.237907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9765e-5a6a-49f9-8da9-7938b5cdadcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:31.238237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9765e-5a6a-49f9-8da9-7938b5cdadcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:31.239730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9765e-5a6a-49f9-8da9-7938b5cdadcc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:31.264921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 293/582] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:31.265821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9765e-5a6a-49f9-8da9-7938b5cdadcc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.324992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bf117-12a5-49b6-af81-e4ed00f68061 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:31.339242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:31.369733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d512df-ca5a-442c-b93b-89036412f0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:31.370796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d512df-ca5a-442c-b93b-89036412f0db None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:31.370968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d512df-ca5a-442c-b93b-89036412f0db None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:31.372253 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d512df-ca5a-442c-b93b-89036412f0db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:31.382009 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d512df-ca5a-442c-b93b-89036412f0db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:31.383473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d512df-ca5a-442c-b93b-89036412f0db None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:31.394814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9765e-5a6a-49f9-8da9-7938b5cdadcc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-89d512df-ca5a-442c-b93b-89036412f0db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:31.400591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:31.401625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:31.403168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:31.407180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 290/583] 10.222.0.90 () {56 vars in 1093 bytes} [Tue Jun 21 15:00:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:31.407180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d512df-ca5a-442c-b93b-89036412f0db None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.434059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:31.444611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb6cff-97c0-4bd6-b7c5-e43af96bf116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:31.445384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb6cff-97c0-4bd6-b7c5-e43af96bf116 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:31.445696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb6cff-97c0-4bd6-b7c5-e43af96bf116 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:31.445971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb6cff-97c0-4bd6-b7c5-e43af96bf116 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:31.446940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb6cff-97c0-4bd6-b7c5-e43af96bf116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:31.447356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb6cff-97c0-4bd6-b7c5-e43af96bf116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:31.448754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb6cff-97c0-4bd6-b7c5-e43af96bf116 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:31.463294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 294/584] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:31.464444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb6cff-97c0-4bd6-b7c5-e43af96bf116 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.531604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d512df-ca5a-442c-b93b-89036412f0db None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:31.572598 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44d1df-24da-415f-8850-88c57a2e8303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:31.573591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d1df-24da-415f-8850-88c57a2e8303 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:31.573864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d1df-24da-415f-8850-88c57a2e8303 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:31.574204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d1df-24da-415f-8850-88c57a2e8303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:31.587787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44d1df-24da-415f-8850-88c57a2e8303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:31.589248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44d1df-24da-415f-8850-88c57a2e8303 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:31.606199 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb6cff-97c0-4bd6-b7c5-e43af96bf116 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ad44d1df-24da-415f-8850-88c57a2e8303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:31.608860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:31.609981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:31.610949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:31.610949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:31.610949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:31.610949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:31.613853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 291/585] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:31.614982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44d1df-24da-415f-8850-88c57a2e8303 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.637977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:31.653781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2b414-5e54-4054-8e45-a9e1b6b7f5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:31.654537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2b414-5e54-4054-8e45-a9e1b6b7f5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:31.655182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2b414-5e54-4054-8e45-a9e1b6b7f5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:31.655182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2b414-5e54-4054-8e45-a9e1b6b7f5f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:31.656117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2b414-5e54-4054-8e45-a9e1b6b7f5f1 None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=8ebffb0a0cf04bc0809a94ddd3a347b9) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:31.656431 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2b414-5e54-4054-8e45-a9e1b6b7f5f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:31.658539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2b414-5e54-4054-8e45-a9e1b6b7f5f1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:31.673515 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 295/586] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:31 2022] GET /identity/v3/role_assignments?user.id=8ebffb0a0cf04bc0809a94ddd3a347b9&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:31.673515 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2b414-5e54-4054-8e45-a9e1b6b7f5f1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.729686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:31.772672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44d1df-24da-415f-8850-88c57a2e8303 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:31.820719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e707bb7-711d-4fca-ad3c-56d160fcf4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:31.821399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e707bb7-711d-4fca-ad3c-56d160fcf4ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:31.821714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e707bb7-711d-4fca-ad3c-56d160fcf4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:31.821988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e707bb7-711d-4fca-ad3c-56d160fcf4ba None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:31.822834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e707bb7-711d-4fca-ad3c-56d160fcf4ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:31.823147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e707bb7-711d-4fca-ad3c-56d160fcf4ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:31.825746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e707bb7-711d-4fca-ad3c-56d160fcf4ba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:31.844232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2b414-5e54-4054-8e45-a9e1b6b7f5f1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:31.854114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 292/587] 10.222.0.90 () {56 vars in 1133 bytes} [Tue Jun 21 15:00:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:31.855300 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e707bb7-711d-4fca-ad3c-56d160fcf4ba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.888935 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da8eaf-a972-4207-8aaa-c3a9426054e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:31.889769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da8eaf-a972-4207-8aaa-c3a9426054e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:31.890056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da8eaf-a972-4207-8aaa-c3a9426054e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:31.890335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da8eaf-a972-4207-8aaa-c3a9426054e8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:31.898848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da8eaf-a972-4207-8aaa-c3a9426054e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:31.900359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da8eaf-a972-4207-8aaa-c3a9426054e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a0da8eaf-a972-4207-8aaa-c3a9426054e8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:31.922328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:31.923868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 296/588] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:31.925395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da8eaf-a972-4207-8aaa-c3a9426054e8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:31.992644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:32.023885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e707bb7-711d-4fca-ad3c-56d160fcf4ba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:32.056161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da8eaf-a972-4207-8aaa-c3a9426054e8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:32.066836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:32.072381 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a26c8a-09e0-42bf-aa21-68a018deab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:32.073306 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26c8a-09e0-42bf-aa21-68a018deab6e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:32.073678 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26c8a-09e0-42bf-aa21-68a018deab6e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:32.074726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26c8a-09e0-42bf-aa21-68a018deab6e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:32.075471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a26c8a-09e0-42bf-aa21-68a018deab6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:32.076059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a26c8a-09e0-42bf-aa21-68a018deab6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:32.077704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a26c8a-09e0-42bf-aa21-68a018deab6e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:32.097804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 293/589] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:32.100072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a26c8a-09e0-42bf-aa21-68a018deab6e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:32.105995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872c5ad-a084-471c-99c2-dd7c51237761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:32.107289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872c5ad-a084-471c-99c2-dd7c51237761 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:32.107794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872c5ad-a084-471c-99c2-dd7c51237761 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:32.108097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872c5ad-a084-471c-99c2-dd7c51237761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:32.122090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872c5ad-a084-471c-99c2-dd7c51237761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:32.123977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872c5ad-a084-471c-99c2-dd7c51237761 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e872c5ad-a084-471c-99c2-dd7c51237761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:32.144154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:32.145090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:32.146083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:32.146083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:32.146083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:32.146083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:32.150388 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 297/590] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:32.151636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872c5ad-a084-471c-99c2-dd7c51237761 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:32.253052 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a26c8a-09e0-42bf-aa21-68a018deab6e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:32.282275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:32.288713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872c5ad-a084-471c-99c2-dd7c51237761 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:32.294738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e855aa-2ca1-4de5-999e-b52b0ed89e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:32.295584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e855aa-2ca1-4de5-999e-b52b0ed89e07 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:32.295950 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e855aa-2ca1-4de5-999e-b52b0ed89e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:32.296310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e855aa-2ca1-4de5-999e-b52b0ed89e07 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:32.297267 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e855aa-2ca1-4de5-999e-b52b0ed89e07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:32.297688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e855aa-2ca1-4de5-999e-b52b0ed89e07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:32.299238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e855aa-2ca1-4de5-999e-b52b0ed89e07 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:32.324855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 294/591] 10.222.0.90 () {56 vars in 1137 bytes} [Tue Jun 21 15:00:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:32.324855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e855aa-2ca1-4de5-999e-b52b0ed89e07 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:32.342222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea674b-ea90-47b9-9f82-d87fbf88bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:32.343354 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea674b-ea90-47b9-9f82-d87fbf88bb5b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:32.344106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea674b-ea90-47b9-9f82-d87fbf88bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:32.344571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea674b-ea90-47b9-9f82-d87fbf88bb5b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:32.355111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea674b-ea90-47b9-9f82-d87fbf88bb5b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:32.358150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea674b-ea90-47b9-9f82-d87fbf88bb5b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-75ea674b-ea90-47b9-9f82-d87fbf88bb5b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:32.377845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:32.378895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:00:32.379866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:32.382835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 298/592] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:32.384132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea674b-ea90-47b9-9f82-d87fbf88bb5b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:32.390891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:32.460042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e855aa-2ca1-4de5-999e-b52b0ed89e07 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:32.502136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03685ff-0581-4d68-bba7-1f55a901fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:32.503189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03685ff-0581-4d68-bba7-1f55a901fb42 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:32.503703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03685ff-0581-4d68-bba7-1f55a901fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:32.504173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03685ff-0581-4d68-bba7-1f55a901fb42 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:32.505102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03685ff-0581-4d68-bba7-1f55a901fb42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:32.505659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03685ff-0581-4d68-bba7-1f55a901fb42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:32.507347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03685ff-0581-4d68-bba7-1f55a901fb42 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:32.525055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 295/593] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:32.526338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03685ff-0581-4d68-bba7-1f55a901fb42 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:32.534934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea674b-ea90-47b9-9f82-d87fbf88bb5b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:32.581669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca89ad6-d287-48ba-9475-acc899267019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:32.582934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca89ad6-d287-48ba-9475-acc899267019 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:32.583418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca89ad6-d287-48ba-9475-acc899267019 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:32.583939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca89ad6-d287-48ba-9475-acc899267019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:32.597531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca89ad6-d287-48ba-9475-acc899267019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:32.599425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca89ad6-d287-48ba-9475-acc899267019 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fca89ad6-d287-48ba-9475-acc899267019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:32.619260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:32.620244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:32.621160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:32.621160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:32.621160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:32.621160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:32.623676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 299/594] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:32.624873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca89ad6-d287-48ba-9475-acc899267019 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:32.647692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:32.666070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03685ff-0581-4d68-bba7-1f55a901fb42 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:32.680145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:32.721794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995904b-0093-4613-8422-f9a5eeda5b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:32.722931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995904b-0093-4613-8422-f9a5eeda5b0f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:32.723421 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995904b-0093-4613-8422-f9a5eeda5b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:32.723862 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995904b-0093-4613-8422-f9a5eeda5b0f None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:32.726898 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995904b-0093-4613-8422-f9a5eeda5b0f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:32.727388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995904b-0093-4613-8422-f9a5eeda5b0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:32.729730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995904b-0093-4613-8422-f9a5eeda5b0f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:32.759428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 296/595] 10.222.0.90 () {56 vars in 1139 bytes} [Tue Jun 21 15:00:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:32.761193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995904b-0093-4613-8422-f9a5eeda5b0f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:32.767193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca89ad6-d287-48ba-9475-acc899267019 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:32.822880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0265603-ef36-40a8-9c12-d91d6f1246cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:32.824674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0265603-ef36-40a8-9c12-d91d6f1246cd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:32.825042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0265603-ef36-40a8-9c12-d91d6f1246cd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:32.825453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0265603-ef36-40a8-9c12-d91d6f1246cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:32.839831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0265603-ef36-40a8-9c12-d91d6f1246cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:32.843466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0265603-ef36-40a8-9c12-d91d6f1246cd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f0265603-ef36-40a8-9c12-d91d6f1246cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:32.867717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:32.869329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:32.871711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:32.871711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:32.871711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:32.871711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:32.871711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:32.871711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:32.871711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:32.871711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:32.873900 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 300/596] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:32.874856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0265603-ef36-40a8-9c12-d91d6f1246cd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:32.908928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995904b-0093-4613-8422-f9a5eeda5b0f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:32.961557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2985bdb-8a32-4b87-a0a8-bdd547086ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:32.962678 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2985bdb-8a32-4b87-a0a8-bdd547086ebc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:32.963190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2985bdb-8a32-4b87-a0a8-bdd547086ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:32.963640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2985bdb-8a32-4b87-a0a8-bdd547086ebc None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:32.964832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2985bdb-8a32-4b87-a0a8-bdd547086ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:32.965976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2985bdb-8a32-4b87-a0a8-bdd547086ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:32.968271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2985bdb-8a32-4b87-a0a8-bdd547086ebc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:32.984723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:32.991522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 297/597] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:32.991522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2985bdb-8a32-4b87-a0a8-bdd547086ebc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:33.037881 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0265603-ef36-40a8-9c12-d91d6f1246cd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:33.056330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:33.075515 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d3dd8-8e6e-4446-a587-676ba08eaada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:33.076895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d3dd8-8e6e-4446-a587-676ba08eaada None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:33.077334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d3dd8-8e6e-4446-a587-676ba08eaada None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:33.077785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d3dd8-8e6e-4446-a587-676ba08eaada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:33.092375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d3dd8-8e6e-4446-a587-676ba08eaada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:33.095250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d3dd8-8e6e-4446-a587-676ba08eaada None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b37d3dd8-8e6e-4446-a587-676ba08eaada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:33.115081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:33.116164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:33.117278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:33.117278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:33.117278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:33.117278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:33.119142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 301/598] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:33.120142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d3dd8-8e6e-4446-a587-676ba08eaada None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:33.138609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2985bdb-8a32-4b87-a0a8-bdd547086ebc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:33.187629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62320ac2-2b1f-4f89-ba68-f1649fae0506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:33.188736 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62320ac2-2b1f-4f89-ba68-f1649fae0506 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:33.189276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62320ac2-2b1f-4f89-ba68-f1649fae0506 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:33.189840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62320ac2-2b1f-4f89-ba68-f1649fae0506 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:33.191941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62320ac2-2b1f-4f89-ba68-f1649fae0506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:33.192920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62320ac2-2b1f-4f89-ba68-f1649fae0506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:33.196147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62320ac2-2b1f-4f89-ba68-f1649fae0506 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:33.221786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 298/599] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:33.223448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62320ac2-2b1f-4f89-ba68-f1649fae0506 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:33.245088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d3dd8-8e6e-4446-a587-676ba08eaada None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:33.310147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa92a97-48e3-4342-95e9-097b215fdd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:33.311424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa92a97-48e3-4342-95e9-097b215fdd81 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:33.311851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa92a97-48e3-4342-95e9-097b215fdd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:33.312528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa92a97-48e3-4342-95e9-097b215fdd81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:33.313861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:33.322083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa92a97-48e3-4342-95e9-097b215fdd81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:33.324000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa92a97-48e3-4342-95e9-097b215fdd81 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:33.336157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5fa92a97-48e3-4342-95e9-097b215fdd81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:33.341321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:33.342360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:33.343275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:33.343275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:33.343275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:33.343275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:33.343275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:33.343275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:33.343275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:33.343275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:33.345142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 302/600] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:33.346193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa92a97-48e3-4342-95e9-097b215fdd81 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:33.351294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62320ac2-2b1f-4f89-ba68-f1649fae0506 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:33.408632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162a3fc-ebf2-4e61-bc85-a38b2e09a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:33.409658 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162a3fc-ebf2-4e61-bc85-a38b2e09a50a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:33.410092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162a3fc-ebf2-4e61-bc85-a38b2e09a50a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:33.410507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162a3fc-ebf2-4e61-bc85-a38b2e09a50a None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:33.411619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162a3fc-ebf2-4e61-bc85-a38b2e09a50a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:33.412083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162a3fc-ebf2-4e61-bc85-a38b2e09a50a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:33.414317 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162a3fc-ebf2-4e61-bc85-a38b2e09a50a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:33.438945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 299/601] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:33.438945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcf205-6469-475c-bfb9-7c84577f6f6d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:33.438945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcf205-6469-475c-bfb9-7c84577f6f6d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:33.438945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcf205-6469-475c-bfb9-7c84577f6f6d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:33.439689 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 300/602] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:33.440868 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcf205-6469-475c-bfb9-7c84577f6f6d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:33.471115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa92a97-48e3-4342-95e9-097b215fdd81 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:33.532567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607ff6-b714-4209-925c-62122a08a16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:33.533710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607ff6-b714-4209-925c-62122a08a16d None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:33.534185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607ff6-b714-4209-925c-62122a08a16d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:33.534653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607ff6-b714-4209-925c-62122a08a16d None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/2bd3ffc0a30648139b2cbf19bb6bd535/roles/ce176ffaea984efb879ec3a4c2da0742` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:33.561273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e607ff6-b714-4209-925c-62122a08a16d None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=2bd3ffc0a30648139b2cbf19bb6bd535, role_id=ce176ffaea984efb879ec3a4c2da0742)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:33.564655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e607ff6-b714-4209-925c-62122a08a16d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:33.586589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 303/603] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:00:33 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/2bd3ffc0a30648139b2cbf19bb6bd535/roles/ce176ffaea984efb879ec3a4c2da0742 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:33.587839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607ff6-b714-4209-925c-62122a08a16d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:33.606116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcf205-6469-475c-bfb9-7c84577f6f6d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:33.649840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:33.666251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38297afe-dd3f-4ac2-befc-7fd6c43700bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:33.668038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297afe-dd3f-4ac2-befc-7fd6c43700bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:33.668615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297afe-dd3f-4ac2-befc-7fd6c43700bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:33.669077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297afe-dd3f-4ac2-befc-7fd6c43700bc None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:33.671359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38297afe-dd3f-4ac2-befc-7fd6c43700bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:33.671913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38297afe-dd3f-4ac2-befc-7fd6c43700bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:33.674527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38297afe-dd3f-4ac2-befc-7fd6c43700bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:33.708803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 301/604] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:33.708803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e251b4-1561-4c9d-8c97-98bc593777fc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:33.708803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e251b4-1561-4c9d-8c97-98bc593777fc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:33.708803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e251b4-1561-4c9d-8c97-98bc593777fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:33.738357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-88e251b4-1561-4c9d-8c97-98bc593777fc None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:33.741166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88e251b4-1561-4c9d-8c97-98bc593777fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:33.746872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:33.778910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607ff6-b714-4209-925c-62122a08a16d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:33.838107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d909a-a8f4-43d4-9d27-4639c409d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:33.839745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d909a-a8f4-43d4-9d27-4639c409d1cf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:33.840299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d909a-a8f4-43d4-9d27-4639c409d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:33.841068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d909a-a8f4-43d4-9d27-4639c409d1cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:33.851481 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d909a-a8f4-43d4-9d27-4639c409d1cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:33.853408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d909a-a8f4-43d4-9d27-4639c409d1cf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:33.860262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 302/605] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:33.860262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e251b4-1561-4c9d-8c97-98bc593777fc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6c1d909a-a8f4-43d4-9d27-4639c409d1cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:33.877940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:33.879053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:33.879994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:33.879994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:33.879994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:33.879994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:33.879994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:33.879994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:33.879994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:33.879994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:33.888057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 304/606] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:33.894809 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d909a-a8f4-43d4-9d27-4639c409d1cf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:34.021445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e251b4-1561-4c9d-8c97-98bc593777fc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:34.036389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:34.045058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d909a-a8f4-43d4-9d27-4639c409d1cf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:34.064519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19786c-2385-408e-8d30-4a4fdff2be69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:34.065628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19786c-2385-408e-8d30-4a4fdff2be69 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:34.065980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19786c-2385-408e-8d30-4a4fdff2be69 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:34.066328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19786c-2385-408e-8d30-4a4fdff2be69 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/27ac2738bf434afabe3d227dc5e52650/roles/ce176ffaea984efb879ec3a4c2da0742` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:34.078011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:34.083972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06574a99-42c8-40c3-96a3-e9d2cc18da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:34.084774 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574a99-42c8-40c3-96a3-e9d2cc18da74 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:34.085148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574a99-42c8-40c3-96a3-e9d2cc18da74 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:34.085644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574a99-42c8-40c3-96a3-e9d2cc18da74 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:34.086430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06574a99-42c8-40c3-96a3-e9d2cc18da74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:34.086844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06574a99-42c8-40c3-96a3-e9d2cc18da74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:34.087448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19786c-2385-408e-8d30-4a4fdff2be69 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=27ac2738bf434afabe3d227dc5e52650, role_id=ce176ffaea984efb879ec3a4c2da0742)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:34.088545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06574a99-42c8-40c3-96a3-e9d2cc18da74 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:34.088989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19786c-2385-408e-8d30-4a4fdff2be69 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:34.114365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 305/607] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:34.115621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06574a99-42c8-40c3-96a3-e9d2cc18da74 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:34.126726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 303/608] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:00:33 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/27ac2738bf434afabe3d227dc5e52650/roles/ce176ffaea984efb879ec3a4c2da0742 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:34.139780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59819f85-0757-4519-8974-8cd429141e11 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:34.140211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59819f85-0757-4519-8974-8cd429141e11 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:34.140634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59819f85-0757-4519-8974-8cd429141e11 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:34.147466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 304/609] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:34 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:34.147466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59819f85-0757-4519-8974-8cd429141e11 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:34.276316 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06574a99-42c8-40c3-96a3-e9d2cc18da74 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:34.287883 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59819f85-0757-4519-8974-8cd429141e11 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:34.329744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a091626-eb01-428e-96ca-862eae94ba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:34.330819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a091626-eb01-428e-96ca-862eae94ba08 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:34.331257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a091626-eb01-428e-96ca-862eae94ba08 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:34.331542 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a091626-eb01-428e-96ca-862eae94ba08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:34.336021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c62f-0096-46f6-8d94-281239eb51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:34.336908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c62f-0096-46f6-8d94-281239eb51b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:34.337213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c62f-0096-46f6-8d94-281239eb51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:34.337457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c62f-0096-46f6-8d94-281239eb51b3 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/08b3093a7415419cbb6d50701b09b7e8/roles/ce176ffaea984efb879ec3a4c2da0742` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:34.345197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a091626-eb01-428e-96ca-862eae94ba08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6a091626-eb01-428e-96ca-862eae94ba08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:34.353499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:34.354477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:34.355327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 306/610] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:34.356182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7e68f-2be1-41a6-8323-21e32630c5a6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:34.356751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7e68f-2be1-41a6-8323-21e32630c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:34.356751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7e68f-2be1-41a6-8323-21e32630c5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:34.360044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993c62f-0096-46f6-8d94-281239eb51b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=08b3093a7415419cbb6d50701b09b7e8, role_id=ce176ffaea984efb879ec3a4c2da0742)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:34.361776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993c62f-0096-46f6-8d94-281239eb51b3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:34.380113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 305/611] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:00:34 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/08b3093a7415419cbb6d50701b09b7e8/roles/ce176ffaea984efb879ec3a4c2da0742 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:34.381077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-85f7e68f-2be1-41a6-8323-21e32630c5a6 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:34.381571 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c62f-0096-46f6-8d94-281239eb51b3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:34.385533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85f7e68f-2be1-41a6-8323-21e32630c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:34.408110 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:34.468044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:34.533981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 307/612] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:34.563371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7e68f-2be1-41a6-8323-21e32630c5a6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:34.610896 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c62f-0096-46f6-8d94-281239eb51b3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:34.661037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66b57-9c19-45ec-93ed-2a7effc8e170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:34.661659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66b57-9c19-45ec-93ed-2a7effc8e170 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:34.661949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66b57-9c19-45ec-93ed-2a7effc8e170 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:34.662231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66b57-9c19-45ec-93ed-2a7effc8e170 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:34.662996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc66b57-9c19-45ec-93ed-2a7effc8e170 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:34.663372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc66b57-9c19-45ec-93ed-2a7effc8e170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:34.664840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc66b57-9c19-45ec-93ed-2a7effc8e170 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:34.676715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 306/613] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:34.682401 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66b57-9c19-45ec-93ed-2a7effc8e170 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:34.757711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7e68f-2be1-41a6-8323-21e32630c5a6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:34.802037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:34.806242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66b57-9c19-45ec-93ed-2a7effc8e170 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:34.831718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82607359-7e2b-49b6-8e90-b6e82b1f9656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:34.832585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82607359-7e2b-49b6-8e90-b6e82b1f9656 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:34.832879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82607359-7e2b-49b6-8e90-b6e82b1f9656 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:34.833160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82607359-7e2b-49b6-8e90-b6e82b1f9656 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:34.850485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0289fa-fb0e-4b07-9149-39a6b15efad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:34.851373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0289fa-fb0e-4b07-9149-39a6b15efad6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:34.851674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0289fa-fb0e-4b07-9149-39a6b15efad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:34.851794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82607359-7e2b-49b6-8e90-b6e82b1f9656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:34.851973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0289fa-fb0e-4b07-9149-39a6b15efad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-82607359-7e2b-49b6-8e90-b6e82b1f9656 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:34.860863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:34.862056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:34.862920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:34.866508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0289fa-fb0e-4b07-9149-39a6b15efad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:34.867493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 308/614] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:34.868386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0289fa-fb0e-4b07-9149-39a6b15efad6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:34.868879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82607359-7e2b-49b6-8e90-b6e82b1f9656 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:34.873251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4e0289fa-fb0e-4b07-9149-39a6b15efad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:34.890642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:34.891676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:34.892634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:34.892634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:34.892634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:34.892634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:34.895311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 307/615] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:34.903728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0289fa-fb0e-4b07-9149-39a6b15efad6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:35.032276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0289fa-fb0e-4b07-9149-39a6b15efad6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:35.071527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8b5e7-4708-4f22-9ba5-9190178ac6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:35.072584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8b5e7-4708-4f22-9ba5-9190178ac6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:35.073092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8b5e7-4708-4f22-9ba5-9190178ac6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:35.073597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8b5e7-4708-4f22-9ba5-9190178ac6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:35.075116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8b5e7-4708-4f22-9ba5-9190178ac6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:35.075819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8b5e7-4708-4f22-9ba5-9190178ac6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:35.077622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8b5e7-4708-4f22-9ba5-9190178ac6d3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:35.091650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 308/616] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:35.097619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8b5e7-4708-4f22-9ba5-9190178ac6d3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:35.124796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82607359-7e2b-49b6-8e90-b6e82b1f9656 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:35.138163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:35.186301 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d705aea-6cec-4037-9fd4-81caacfa2c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:35.187054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d705aea-6cec-4037-9fd4-81caacfa2c2d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:35.187365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d705aea-6cec-4037-9fd4-81caacfa2c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:35.187687 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d705aea-6cec-4037-9fd4-81caacfa2c2d None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:35.188530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d705aea-6cec-4037-9fd4-81caacfa2c2d None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:35.189067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d705aea-6cec-4037-9fd4-81caacfa2c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:35.190417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d705aea-6cec-4037-9fd4-81caacfa2c2d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:35.215492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8b5e7-4708-4f22-9ba5-9190178ac6d3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:35.219797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 309/617] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:35.230612 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d705aea-6cec-4037-9fd4-81caacfa2c2d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:35.255256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280075-1f48-4d4e-ba6a-2bbfe58a2e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:35.256471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280075-1f48-4d4e-ba6a-2bbfe58a2e18 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:35.256999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280075-1f48-4d4e-ba6a-2bbfe58a2e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:35.257520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e280075-1f48-4d4e-ba6a-2bbfe58a2e18 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:35.267440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280075-1f48-4d4e-ba6a-2bbfe58a2e18 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:35.269275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e280075-1f48-4d4e-ba6a-2bbfe58a2e18 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7e280075-1f48-4d4e-ba6a-2bbfe58a2e18 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:35.286589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:35.287622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:00:35.288562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:35.291423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 309/618] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:35.298878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280075-1f48-4d4e-ba6a-2bbfe58a2e18 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:35.405994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:35.423417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e280075-1f48-4d4e-ba6a-2bbfe58a2e18 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:35.461347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:35.498719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723bdbf-0cce-4733-bfec-5207b022f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:35.500284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723bdbf-0cce-4733-bfec-5207b022f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:35.500779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723bdbf-0cce-4733-bfec-5207b022f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:35.501256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723bdbf-0cce-4733-bfec-5207b022f5f4 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:35.502371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723bdbf-0cce-4733-bfec-5207b022f5f4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:35.502958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723bdbf-0cce-4733-bfec-5207b022f5f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:35.504819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723bdbf-0cce-4733-bfec-5207b022f5f4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:35.524873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 310/619] 10.222.0.90 () {56 vars in 1137 bytes} [Tue Jun 21 15:00:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:35.530718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723bdbf-0cce-4733-bfec-5207b022f5f4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:35.592826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d705aea-6cec-4037-9fd4-81caacfa2c2d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:35.688659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e047a-e069-4608-9c40-c22aabaed819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:35.690020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e047a-e069-4608-9c40-c22aabaed819 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:35.690539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e047a-e069-4608-9c40-c22aabaed819 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:35.691058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e047a-e069-4608-9c40-c22aabaed819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:35.714025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e047a-e069-4608-9c40-c22aabaed819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:35.716618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e047a-e069-4608-9c40-c22aabaed819 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:35.754838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723bdbf-0cce-4733-bfec-5207b022f5f4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-997e047a-e069-4608-9c40-c22aabaed819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:35.763637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:35.764598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:35.765530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:35.765530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:35.765530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:35.765530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:35.771075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 310/620] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 541 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:35.777524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e047a-e069-4608-9c40-c22aabaed819 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:35.828424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:35.858987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1281a8-c2fc-411e-90e7-2584860eebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:35.859713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1281a8-c2fc-411e-90e7-2584860eebc5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:35.860030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1281a8-c2fc-411e-90e7-2584860eebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:35.860349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1281a8-c2fc-411e-90e7-2584860eebc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:35.938282 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e047a-e069-4608-9c40-c22aabaed819 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:35.975527 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:36.015221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20e227-6ad1-466a-acef-cd6b1764e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:36.015896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20e227-6ad1-466a-acef-cd6b1764e99c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.016175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20e227-6ad1-466a-acef-cd6b1764e99c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.016453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20e227-6ad1-466a-acef-cd6b1764e99c None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.017191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20e227-6ad1-466a-acef-cd6b1764e99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:36.017516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20e227-6ad1-466a-acef-cd6b1764e99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:36.018906 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20e227-6ad1-466a-acef-cd6b1764e99c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:36.028010 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1281a8-c2fc-411e-90e7-2584860eebc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:36.030220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1281a8-c2fc-411e-90e7-2584860eebc5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:36.051710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 311/621] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:36.056908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20e227-6ad1-466a-acef-cd6b1764e99c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:36.207829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 311/622] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 15:00:36.210846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a09c7-23aa-47e4-8fdc-55fcc5b5081f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.211137 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a09c7-23aa-47e4-8fdc-55fcc5b5081f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.211423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a09c7-23aa-47e4-8fdc-55fcc5b5081f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.214306 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 312/623] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:36.216133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a09c7-23aa-47e4-8fdc-55fcc5b5081f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:36.229827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20e227-6ad1-466a-acef-cd6b1764e99c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:36.259915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:36.285202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affecb25-5286-48c9-9178-f46082cd2627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:36.286492 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affecb25-5286-48c9-9178-f46082cd2627 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.287053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affecb25-5286-48c9-9178-f46082cd2627 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.287487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affecb25-5286-48c9-9178-f46082cd2627 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.300241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affecb25-5286-48c9-9178-f46082cd2627 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:36.303307 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affecb25-5286-48c9-9178-f46082cd2627 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-affecb25-5286-48c9-9178-f46082cd2627 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:36.329990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:36.331875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:36.333448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:36.337249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 312/624] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:36.339786 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba6ebf-dce0-42c4-9870-d58728be8ecd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.341699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba6ebf-dce0-42c4-9870-d58728be8ecd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.342277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba6ebf-dce0-42c4-9870-d58728be8ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.346244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a09c7-23aa-47e4-8fdc-55fcc5b5081f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:36.367275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e5ba6ebf-dce0-42c4-9870-d58728be8ecd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:36.368802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5ba6ebf-dce0-42c4-9870-d58728be8ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:36.389594 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a14d3c-8bb0-4d03-ac4a-66703dcd378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:36.390766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a14d3c-8bb0-4d03-ac4a-66703dcd378a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.391236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a14d3c-8bb0-4d03-ac4a-66703dcd378a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.391745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a14d3c-8bb0-4d03-ac4a-66703dcd378a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.404090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a14d3c-8bb0-4d03-ac4a-66703dcd378a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:36.406032 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a14d3c-8bb0-4d03-ac4a-66703dcd378a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:36.407657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a2a14d3c-8bb0-4d03-ac4a-66703dcd378a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:36.429167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:36.430219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:36.431116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:36.431116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:36.431116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:36.431116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:36.434177 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 313/625] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:36.435573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a14d3c-8bb0-4d03-ac4a-66703dcd378a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:36.469496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 313/626] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:36.469496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba6ebf-dce0-42c4-9870-d58728be8ecd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:36.558210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:36.584033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a14d3c-8bb0-4d03-ac4a-66703dcd378a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:36.593749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba6ebf-dce0-42c4-9870-d58728be8ecd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:36.632650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139c831-b22e-41bd-b822-b0d15cc9a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:36.633667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c831-b22e-41bd-b822-b0d15cc9a80f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.634834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c831-b22e-41bd-b822-b0d15cc9a80f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.635332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c831-b22e-41bd-b822-b0d15cc9a80f None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.636175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139c831-b22e-41bd-b822-b0d15cc9a80f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:36.636484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139c831-b22e-41bd-b822-b0d15cc9a80f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:36.638949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139c831-b22e-41bd-b822-b0d15cc9a80f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:36.647670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef62b18-8453-4b31-a10d-70bfa8182a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:36.649685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef62b18-8453-4b31-a10d-70bfa8182a71 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.650181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef62b18-8453-4b31-a10d-70bfa8182a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.650724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef62b18-8453-4b31-a10d-70bfa8182a71 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.651724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef62b18-8453-4b31-a10d-70bfa8182a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:36.652232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef62b18-8453-4b31-a10d-70bfa8182a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:36.655262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef62b18-8453-4b31-a10d-70bfa8182a71 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:36.658733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 314/627] 10.222.0.90 () {56 vars in 1135 bytes} [Tue Jun 21 15:00:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:36.659589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139c831-b22e-41bd-b822-b0d15cc9a80f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:36.680555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 314/628] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:36.680555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef62b18-8453-4b31-a10d-70bfa8182a71 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:36.721249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:36.797484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139c831-b22e-41bd-b822-b0d15cc9a80f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:36.822759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef62b18-8453-4b31-a10d-70bfa8182a71 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:36.833504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebeaa8-7341-400e-845f-9176b55973ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:36.834313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebeaa8-7341-400e-845f-9176b55973ca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.834593 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebeaa8-7341-400e-845f-9176b55973ca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.834884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebeaa8-7341-400e-845f-9176b55973ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.845455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:36.850419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebeaa8-7341-400e-845f-9176b55973ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ddebeaa8-7341-400e-845f-9176b55973ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:36.862088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:36.863135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:36.864026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:36.866019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 315/629] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:36.866019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebeaa8-7341-400e-845f-9176b55973ca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:36.874236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089ec47-0591-4218-9ca2-54104d4d5c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:36.875052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089ec47-0591-4218-9ca2-54104d4d5c29 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.875321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089ec47-0591-4218-9ca2-54104d4d5c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.875596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089ec47-0591-4218-9ca2-54104d4d5c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.887984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089ec47-0591-4218-9ca2-54104d4d5c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:36.889443 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089ec47-0591-4218-9ca2-54104d4d5c29 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d089ec47-0591-4218-9ca2-54104d4d5c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:36.908701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:36.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:36.910643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:36.910643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:36.910643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:36.910643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:36.915552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 315/630] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:36.917131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d0b8-ee80-4469-857f-603ecf089405 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:36.917445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d0b8-ee80-4469-857f-603ecf089405 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:36.918232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d0b8-ee80-4469-857f-603ecf089405 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:36.924529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 316/631] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:36.924529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d0b8-ee80-4469-857f-603ecf089405 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:36.992511 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebeaa8-7341-400e-845f-9176b55973ca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:37.040257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:37.047184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f871a66-660a-407c-bdfd-348ef5a07b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:37.047988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f871a66-660a-407c-bdfd-348ef5a07b3d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.048264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f871a66-660a-407c-bdfd-348ef5a07b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.048534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f871a66-660a-407c-bdfd-348ef5a07b3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.055518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f871a66-660a-407c-bdfd-348ef5a07b3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:37.056946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f871a66-660a-407c-bdfd-348ef5a07b3d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:37.070268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d0b8-ee80-4469-857f-603ecf089405 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6f871a66-660a-407c-bdfd-348ef5a07b3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:37.071446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:37.072504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 316/632] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:37.073531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f871a66-660a-407c-bdfd-348ef5a07b3d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:37.116272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee51e8-0b57-4be9-8d5d-26d202329f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:37.116953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee51e8-0b57-4be9-8d5d-26d202329f95 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.117241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee51e8-0b57-4be9-8d5d-26d202329f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.117549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee51e8-0b57-4be9-8d5d-26d202329f95 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.118367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee51e8-0b57-4be9-8d5d-26d202329f95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:37.118622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee51e8-0b57-4be9-8d5d-26d202329f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:37.120032 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee51e8-0b57-4be9-8d5d-26d202329f95 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:37.129994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 317/633] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:37.131348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632a5c8-2539-4541-b24c-dfe938ae1e45 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.131652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632a5c8-2539-4541-b24c-dfe938ae1e45 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.131932 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632a5c8-2539-4541-b24c-dfe938ae1e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.152633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f632a5c8-2539-4541-b24c-dfe938ae1e45 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:37.153411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:37.155105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f632a5c8-2539-4541-b24c-dfe938ae1e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:37.207138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f871a66-660a-407c-bdfd-348ef5a07b3d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:37.233552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 318/634] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:37.235302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de184a-da50-49b7-9af2-e1aecce78858 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.235599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de184a-da50-49b7-9af2-e1aecce78858 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.235880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de184a-da50-49b7-9af2-e1aecce78858 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.237161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 319/635] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:37.237889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de184a-da50-49b7-9af2-e1aecce78858 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:37.253998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c427b-00c5-4f52-9ecb-c02a61908177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:37.254669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c427b-00c5-4f52-9ecb-c02a61908177 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.254951 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c427b-00c5-4f52-9ecb-c02a61908177 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.255229 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c427b-00c5-4f52-9ecb-c02a61908177 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.255960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c427b-00c5-4f52-9ecb-c02a61908177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:37.256260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c427b-00c5-4f52-9ecb-c02a61908177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:37.257658 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c427b-00c5-4f52-9ecb-c02a61908177 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:37.270083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 317/636] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:37.270912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c427b-00c5-4f52-9ecb-c02a61908177 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:37.326729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:37.359752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de184a-da50-49b7-9af2-e1aecce78858 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:37.394163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c427b-00c5-4f52-9ecb-c02a61908177 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:37.401157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f31fe-4e09-4043-838d-bbcb95970e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:37.402027 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f31fe-4e09-4043-838d-bbcb95970e43 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.402401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f31fe-4e09-4043-838d-bbcb95970e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.402705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f31fe-4e09-4043-838d-bbcb95970e43 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.403588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f31fe-4e09-4043-838d-bbcb95970e43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:37.403935 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f31fe-4e09-4043-838d-bbcb95970e43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:37.405444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f31fe-4e09-4043-838d-bbcb95970e43 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:37.417516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 320/637] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:37.419169 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:37.420048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcefd23-32c6-4d31-9d89-6275c77d6ad2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.420348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcefd23-32c6-4d31-9d89-6275c77d6ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.420637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcefd23-32c6-4d31-9d89-6275c77d6ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.441395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3dcefd23-32c6-4d31-9d89-6275c77d6ad2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:37.442668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3dcefd23-32c6-4d31-9d89-6275c77d6ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:37.444080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae8afc-ae55-4067-8c85-f4cdb58d4458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:37.445115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae8afc-ae55-4067-8c85-f4cdb58d4458 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.445489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae8afc-ae55-4067-8c85-f4cdb58d4458 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.446576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae8afc-ae55-4067-8c85-f4cdb58d4458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.459013 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae8afc-ae55-4067-8c85-f4cdb58d4458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:37.460477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae8afc-ae55-4067-8c85-f4cdb58d4458 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8eae8afc-ae55-4067-8c85-f4cdb58d4458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:37.479004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:37.480178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:37.481589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:37.481589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:37.481589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:37.481589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:37.481589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 318/638] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:37.482244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae8afc-ae55-4067-8c85-f4cdb58d4458 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:37.524104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 321/639] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:37.524966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcefd23-32c6-4d31-9d89-6275c77d6ad2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:37.610212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:37.617214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae8afc-ae55-4067-8c85-f4cdb58d4458 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:37.652669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcefd23-32c6-4d31-9d89-6275c77d6ad2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:37.658973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16256-6088-480a-b97a-b66db2969b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:37.659890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16256-6088-480a-b97a-b66db2969b65 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.660247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16256-6088-480a-b97a-b66db2969b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.660562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16256-6088-480a-b97a-b66db2969b65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.674145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df16256-6088-480a-b97a-b66db2969b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7df16256-6088-480a-b97a-b66db2969b65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:37.683203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:37.684917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:37.686082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 319/640] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:37.687490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16256-6088-480a-b97a-b66db2969b65 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:37.692826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fed02-98bf-49b5-ae95-72fec474607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:37.693663 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fed02-98bf-49b5-ae95-72fec474607c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.693955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fed02-98bf-49b5-ae95-72fec474607c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.694228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fed02-98bf-49b5-ae95-72fec474607c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.701118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fed02-98bf-49b5-ae95-72fec474607c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:37.702600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fed02-98bf-49b5-ae95-72fec474607c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-793fed02-98bf-49b5-ae95-72fec474607c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:37.716760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:37.717903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 322/641] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:37.718832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fed02-98bf-49b5-ae95-72fec474607c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:37.724559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:37.801266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16256-6088-480a-b97a-b66db2969b65 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:37.825918 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fed02-98bf-49b5-ae95-72fec474607c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:37.838133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf48bd-0c18-4b55-b11f-c0190d0f8648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:37.838796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf48bd-0c18-4b55-b11f-c0190d0f8648 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.839081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf48bd-0c18-4b55-b11f-c0190d0f8648 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.839374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf48bd-0c18-4b55-b11f-c0190d0f8648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.840695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf48bd-0c18-4b55-b11f-c0190d0f8648 None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=b480c19eb6ec42979a81ad274acb1f40) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:37.841051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf48bd-0c18-4b55-b11f-c0190d0f8648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:37.842554 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf48bd-0c18-4b55-b11f-c0190d0f8648 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:37.848753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 320/642] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:37 2022] GET /identity/v3/role_assignments?user.id=b480c19eb6ec42979a81ad274acb1f40&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:37.849265 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:37.849930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf48bd-0c18-4b55-b11f-c0190d0f8648 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:37.878962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9593e7-4424-4b0e-bd24-adb32adc6c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:37.879582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9593e7-4424-4b0e-bd24-adb32adc6c9d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:37.879869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9593e7-4424-4b0e-bd24-adb32adc6c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:37.880152 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9593e7-4424-4b0e-bd24-adb32adc6c9d None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:37.880900 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9593e7-4424-4b0e-bd24-adb32adc6c9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:37.881215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9593e7-4424-4b0e-bd24-adb32adc6c9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:37.882707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9593e7-4424-4b0e-bd24-adb32adc6c9d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:37.900821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 323/643] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:37.900821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9593e7-4424-4b0e-bd24-adb32adc6c9d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:37.995531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:38.004441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf48bd-0c18-4b55-b11f-c0190d0f8648 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.037120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9593e7-4424-4b0e-bd24-adb32adc6c9d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.052860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498edd7-63e7-4cae-a4b3-610236ba486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.053699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498edd7-63e7-4cae-a4b3-610236ba486e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.053982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498edd7-63e7-4cae-a4b3-610236ba486e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.054256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498edd7-63e7-4cae-a4b3-610236ba486e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.070721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498edd7-63e7-4cae-a4b3-610236ba486e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2498edd7-63e7-4cae-a4b3-610236ba486e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:38.079449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:38.080477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:38.081466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 321/644] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:38.082232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498edd7-63e7-4cae-a4b3-610236ba486e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:38.094262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa82fe7-2651-4cc4-a85f-64873bd847aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.095500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa82fe7-2651-4cc4-a85f-64873bd847aa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.095903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa82fe7-2651-4cc4-a85f-64873bd847aa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.096298 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa82fe7-2651-4cc4-a85f-64873bd847aa None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.097578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa82fe7-2651-4cc4-a85f-64873bd847aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:38.098096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa82fe7-2651-4cc4-a85f-64873bd847aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:38.099617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa82fe7-2651-4cc4-a85f-64873bd847aa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:38.110173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 324/645] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:38.111212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa82fe7-2651-4cc4-a85f-64873bd847aa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:38.178560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:38.217497 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498edd7-63e7-4cae-a4b3-610236ba486e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.254235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa82fe7-2651-4cc4-a85f-64873bd847aa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.258130 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c9e2-3e5a-4386-bd65-dfcc6cbe3cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.258812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c9e2-3e5a-4386-bd65-dfcc6cbe3cab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.259107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c9e2-3e5a-4386-bd65-dfcc6cbe3cab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.259397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c9e2-3e5a-4386-bd65-dfcc6cbe3cab None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.260223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1c9e2-3e5a-4386-bd65-dfcc6cbe3cab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:38.260539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1c9e2-3e5a-4386-bd65-dfcc6cbe3cab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:38.263542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1c9e2-3e5a-4386-bd65-dfcc6cbe3cab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:38.277516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 322/646] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:38.278666 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c9e2-3e5a-4386-bd65-dfcc6cbe3cab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:38.298451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c6706-47c5-49dc-989d-25f71a30ddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.299254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c6706-47c5-49dc-989d-25f71a30ddd3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.299543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c6706-47c5-49dc-989d-25f71a30ddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.299822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c6706-47c5-49dc-989d-25f71a30ddd3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.300596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:38.308281 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c6706-47c5-49dc-989d-25f71a30ddd3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:38.310677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c6706-47c5-49dc-989d-25f71a30ddd3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b41c6706-47c5-49dc-989d-25f71a30ddd3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:38.326512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:38.327604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:38.328548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:38.332548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 325/647] 10.222.0.90 () {56 vars in 1093 bytes} [Tue Jun 21 15:00:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:38.333494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c6706-47c5-49dc-989d-25f71a30ddd3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:38.401708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c9e2-3e5a-4386-bd65-dfcc6cbe3cab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.451562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4d019-c63a-4d1b-86a4-4d3910adf4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.452246 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4d019-c63a-4d1b-86a4-4d3910adf4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.452535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4d019-c63a-4d1b-86a4-4d3910adf4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.452654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c6706-47c5-49dc-989d-25f71a30ddd3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.452818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4d019-c63a-4d1b-86a4-4d3910adf4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.453605 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4d019-c63a-4d1b-86a4-4d3910adf4b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:38.453914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4d019-c63a-4d1b-86a4-4d3910adf4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:38.455725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4d019-c63a-4d1b-86a4-4d3910adf4b5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:38.456175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:38.470841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 323/648] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:38.470841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4d019-c63a-4d1b-86a4-4d3910adf4b5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:38.498315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e7fc4-1244-4661-b966-9bd0836827bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.499148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7fc4-1244-4661-b966-9bd0836827bf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.499430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7fc4-1244-4661-b966-9bd0836827bf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.499706 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e7fc4-1244-4661-b966-9bd0836827bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.511771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e7fc4-1244-4661-b966-9bd0836827bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:38.513411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e7fc4-1244-4661-b966-9bd0836827bf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-240e7fc4-1244-4661-b966-9bd0836827bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:38.534611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:38.535595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:38.536533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:38.536533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:38.536533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:38.536533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:38.536533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 326/649] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:38.537550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e7fc4-1244-4661-b966-9bd0836827bf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:38.571468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:38.604453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4d019-c63a-4d1b-86a4-4d3910adf4b5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.653180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e7fc4-1244-4661-b966-9bd0836827bf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.658262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436bf6-4dd9-4c7b-98ee-249ee813b2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.659151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436bf6-4dd9-4c7b-98ee-249ee813b2e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.659433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436bf6-4dd9-4c7b-98ee-249ee813b2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.659705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436bf6-4dd9-4c7b-98ee-249ee813b2e2 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/8ebffb0a0cf04bc0809a94ddd3a347b9/roles/ce176ffaea984efb879ec3a4c2da0742` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.677896 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07436bf6-4dd9-4c7b-98ee-249ee813b2e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=8ebffb0a0cf04bc0809a94ddd3a347b9, role_id=ce176ffaea984efb879ec3a4c2da0742)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:38.679335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07436bf6-4dd9-4c7b-98ee-249ee813b2e2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:38.701507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 324/650] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:00:38 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/8ebffb0a0cf04bc0809a94ddd3a347b9/roles/ce176ffaea984efb879ec3a4c2da0742 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:38.701507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436bf6-4dd9-4c7b-98ee-249ee813b2e2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:38.713248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9e9bb-63d0-4499-8126-5ee35c02dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.714090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e9bb-63d0-4499-8126-5ee35c02dccc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.714415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e9bb-63d0-4499-8126-5ee35c02dccc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.715574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e9bb-63d0-4499-8126-5ee35c02dccc None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.716521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9e9bb-63d0-4499-8126-5ee35c02dccc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:38.716842 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9e9bb-63d0-4499-8126-5ee35c02dccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:38.718685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9e9bb-63d0-4499-8126-5ee35c02dccc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:38.741534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 327/651] 10.222.0.90 () {56 vars in 1133 bytes} [Tue Jun 21 15:00:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:38.747459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9e9bb-63d0-4499-8126-5ee35c02dccc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:38.769368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:38.847366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436bf6-4dd9-4c7b-98ee-249ee813b2e2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.887190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:38.901676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b61439-9049-43e0-a615-c3c8ae95216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.903916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b61439-9049-43e0-a615-c3c8ae95216c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.904643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b61439-9049-43e0-a615-c3c8ae95216c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.905082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b61439-9049-43e0-a615-c3c8ae95216c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.910296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9e9bb-63d0-4499-8126-5ee35c02dccc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:38.920794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b61439-9049-43e0-a615-c3c8ae95216c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:38.922491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b61439-9049-43e0-a615-c3c8ae95216c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d7b61439-9049-43e0-a615-c3c8ae95216c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:38.943630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:38.944643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:38.945585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:38.945585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:38.945585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:38.945585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:38.945585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 325/652] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:38.946375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b61439-9049-43e0-a615-c3c8ae95216c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:38.960781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6076b-22e7-4d59-8466-f9d52a5dfb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:38.961500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6076b-22e7-4d59-8466-f9d52a5dfb07 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:38.961794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6076b-22e7-4d59-8466-f9d52a5dfb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:38.962079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6076b-22e7-4d59-8466-f9d52a5dfb07 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:38.962814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6076b-22e7-4d59-8466-f9d52a5dfb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:38.963232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6076b-22e7-4d59-8466-f9d52a5dfb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:38.965412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6076b-22e7-4d59-8466-f9d52a5dfb07 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:38.978867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 328/653] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:38.979783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6076b-22e7-4d59-8466-f9d52a5dfb07 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:39.067578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b61439-9049-43e0-a615-c3c8ae95216c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:39.086465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:39.106770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a1d85-06fe-468b-8045-7b9d0815b257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:39.107241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a1d85-06fe-468b-8045-7b9d0815b257 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:39.107532 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a1d85-06fe-468b-8045-7b9d0815b257 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:39.107851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a1d85-06fe-468b-8045-7b9d0815b257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:39.119019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6076b-22e7-4d59-8466-f9d52a5dfb07 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:39.158069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a241aa3-b06f-4452-a106-5adb9cac6cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:39.159055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241aa3-b06f-4452-a106-5adb9cac6cfd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:39.159510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241aa3-b06f-4452-a106-5adb9cac6cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:39.159943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241aa3-b06f-4452-a106-5adb9cac6cfd None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:39.160829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a241aa3-b06f-4452-a106-5adb9cac6cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:39.161304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a241aa3-b06f-4452-a106-5adb9cac6cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:39.162872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a241aa3-b06f-4452-a106-5adb9cac6cfd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:39.169832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:39.177722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 329/654] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:39.178995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a241aa3-b06f-4452-a106-5adb9cac6cfd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:39.187524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a1d85-06fe-468b-8045-7b9d0815b257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:39.188479 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a1d85-06fe-468b-8045-7b9d0815b257 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:39.304045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a241aa3-b06f-4452-a106-5adb9cac6cfd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:39.304848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 326/655] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:39.305810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a1d85-06fe-468b-8045-7b9d0815b257 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:39.345080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40442b39-e962-46a6-abf8-02ed4a451d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:39.346444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40442b39-e962-46a6-abf8-02ed4a451d39 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:39.346942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40442b39-e962-46a6-abf8-02ed4a451d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:39.347428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40442b39-e962-46a6-abf8-02ed4a451d39 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:39.349750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:39.359515 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40442b39-e962-46a6-abf8-02ed4a451d39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:39.361395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40442b39-e962-46a6-abf8-02ed4a451d39 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-40442b39-e962-46a6-abf8-02ed4a451d39 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:39.384411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:39.385459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 15:00:39.387271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:39.390128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 330/656] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:39.391205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40442b39-e962-46a6-abf8-02ed4a451d39 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:39.412187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:39.422103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a1d85-06fe-468b-8045-7b9d0815b257 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:39.462650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b65fc-8e0d-4eb1-8472-285f9c037398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:39.463491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b65fc-8e0d-4eb1-8472-285f9c037398 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:39.464082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b65fc-8e0d-4eb1-8472-285f9c037398 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:39.464211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b65fc-8e0d-4eb1-8472-285f9c037398 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:39.472754 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b65fc-8e0d-4eb1-8472-285f9c037398 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:39.474327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b65fc-8e0d-4eb1-8472-285f9c037398 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f74b65fc-8e0d-4eb1-8472-285f9c037398 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:39.490904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:39.491976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:39.492959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 327/657] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:39.493625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b65fc-8e0d-4eb1-8472-285f9c037398 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:39.519257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40442b39-e962-46a6-abf8-02ed4a451d39 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:39.558004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0423dc4-eeba-4eb5-b230-325e65f8b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:39.560881 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0423dc4-eeba-4eb5-b230-325e65f8b131 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:39.561675 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0423dc4-eeba-4eb5-b230-325e65f8b131 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:39.562162 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0423dc4-eeba-4eb5-b230-325e65f8b131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:39.577624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0423dc4-eeba-4eb5-b230-325e65f8b131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:39.579399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0423dc4-eeba-4eb5-b230-325e65f8b131 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b0423dc4-eeba-4eb5-b230-325e65f8b131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:39.603335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:39.604340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:39.606296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:39.606296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:39.606296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:39.606296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:39.609712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 331/658] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:39.610845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0423dc4-eeba-4eb5-b230-325e65f8b131 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:39.630089 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b65fc-8e0d-4eb1-8472-285f9c037398 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:39.676361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9093dad-06fa-428a-90c1-b7d34ca293dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:39.677304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9093dad-06fa-428a-90c1-b7d34ca293dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:39.677806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9093dad-06fa-428a-90c1-b7d34ca293dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:39.678006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9093dad-06fa-428a-90c1-b7d34ca293dc None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:39.678979 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9093dad-06fa-428a-90c1-b7d34ca293dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:39.679368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9093dad-06fa-428a-90c1-b7d34ca293dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:39.680955 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9093dad-06fa-428a-90c1-b7d34ca293dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:39.682338 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:39.695379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:39.707116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 328/659] 10.222.0.90 () {56 vars in 1137 bytes} [Tue Jun 21 15:00:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:39.708355 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9093dad-06fa-428a-90c1-b7d34ca293dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:39.760619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0423dc4-eeba-4eb5-b230-325e65f8b131 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:39.806097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ebf7b-2546-460f-a7ed-1b90a70a4e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:39.806954 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ebf7b-2546-460f-a7ed-1b90a70a4e9b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:39.807347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ebf7b-2546-460f-a7ed-1b90a70a4e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:39.807728 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ebf7b-2546-460f-a7ed-1b90a70a4e9b None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:39.809732 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ebf7b-2546-460f-a7ed-1b90a70a4e9b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:39.809977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ebf7b-2546-460f-a7ed-1b90a70a4e9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:39.811691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ebf7b-2546-460f-a7ed-1b90a70a4e9b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:39.832523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 332/660] 10.222.0.90 () {56 vars in 1139 bytes} [Tue Jun 21 15:00:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:39.833730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ebf7b-2546-460f-a7ed-1b90a70a4e9b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:39.839975 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9093dad-06fa-428a-90c1-b7d34ca293dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:39.883204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea02dd-e738-450b-aefa-2e49a3edc6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:39.884879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea02dd-e738-450b-aefa-2e49a3edc6eb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:39.885341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea02dd-e738-450b-aefa-2e49a3edc6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:39.885813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea02dd-e738-450b-aefa-2e49a3edc6eb None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:39.887777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea02dd-e738-450b-aefa-2e49a3edc6eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:39.888283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea02dd-e738-450b-aefa-2e49a3edc6eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:39.890617 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea02dd-e738-450b-aefa-2e49a3edc6eb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:39.906014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 329/661] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:39.907135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea02dd-e738-450b-aefa-2e49a3edc6eb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:39.986804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:40.036269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ebf7b-2546-460f-a7ed-1b90a70a4e9b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:40.041225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:40.049054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea02dd-e738-450b-aefa-2e49a3edc6eb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:40.091663 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcbf8-21bb-4f63-8a56-4b102ab13160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:40.092336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcbf8-21bb-4f63-8a56-4b102ab13160 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:40.092666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcbf8-21bb-4f63-8a56-4b102ab13160 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:40.092951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcbf8-21bb-4f63-8a56-4b102ab13160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:40.100351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97fcd7-1c61-4f44-97c1-69356e9a6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:40.101167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97fcd7-1c61-4f44-97c1-69356e9a6e88 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:40.101597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97fcd7-1c61-4f44-97c1-69356e9a6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:40.101974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97fcd7-1c61-4f44-97c1-69356e9a6e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:40.172923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fcbf8-21bb-4f63-8a56-4b102ab13160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:40.174752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fcbf8-21bb-4f63-8a56-4b102ab13160 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:40.202492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97fcd7-1c61-4f44-97c1-69356e9a6e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:40.204593 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97fcd7-1c61-4f44-97c1-69356e9a6e88 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:40.272645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:40.289700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 333/662] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:40.290651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcbf8-21bb-4f63-8a56-4b102ab13160 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:40.297981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:40.326411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 330/663] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:40.328111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a309b-d5c2-4ad8-a6ef-1d69419c602e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:40.328542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a309b-d5c2-4ad8-a6ef-1d69419c602e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:40.328958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a309b-d5c2-4ad8-a6ef-1d69419c602e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:40.330583 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 331/664] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:40.331564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a309b-d5c2-4ad8-a6ef-1d69419c602e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:40.409932 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcbf8-21bb-4f63-8a56-4b102ab13160 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:40.453204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f15cee-33c7-4bea-b482-0797a478e085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:40.454037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f15cee-33c7-4bea-b482-0797a478e085 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:40.454251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a309b-d5c2-4ad8-a6ef-1d69419c602e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:40.454380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f15cee-33c7-4bea-b482-0797a478e085 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:40.454587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f15cee-33c7-4bea-b482-0797a478e085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:40.462057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f15cee-33c7-4bea-b482-0797a478e085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:40.463525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f15cee-33c7-4bea-b482-0797a478e085 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f7f15cee-33c7-4bea-b482-0797a478e085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:40.477792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:40.478773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:40.479891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:40.479891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:40.479891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:40.479891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:40.479891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:40.479891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:40.479891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:40.479891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:40.479891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 334/665] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:40.480471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f15cee-33c7-4bea-b482-0797a478e085 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:40.498701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa41321-afc4-4aaa-b56a-1ddd148839db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:40.499543 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa41321-afc4-4aaa-b56a-1ddd148839db None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:40.499886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa41321-afc4-4aaa-b56a-1ddd148839db None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:40.500165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa41321-afc4-4aaa-b56a-1ddd148839db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:40.511216 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa41321-afc4-4aaa-b56a-1ddd148839db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:40.513829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa41321-afc4-4aaa-b56a-1ddd148839db None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4aa41321-afc4-4aaa-b56a-1ddd148839db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:40.533996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:40.534994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:40.535916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:40.535916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:40.535916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:40.535916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:40.539981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 332/666] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:40.541234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef528-3974-49d8-9e87-d4a6489741ac None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:40.541555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef528-3974-49d8-9e87-d4a6489741ac None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:40.541841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef528-3974-49d8-9e87-d4a6489741ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:40.547864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:40.562629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-329ef528-3974-49d8-9e87-d4a6489741ac None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:40.563854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-329ef528-3974-49d8-9e87-d4a6489741ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:40.567247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:40.588759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f15cee-33c7-4bea-b482-0797a478e085 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:40.625276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8054f-8678-473c-a731-128762649b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:40.626201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8054f-8678-473c-a731-128762649b51 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:40.626492 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8054f-8678-473c-a731-128762649b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:40.626775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8054f-8678-473c-a731-128762649b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:40.638764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8054f-8678-473c-a731-128762649b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:40.640231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8054f-8678-473c-a731-128762649b51 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:40.644107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 333/667] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:40.645138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ef528-3974-49d8-9e87-d4a6489741ac None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1ee8054f-8678-473c-a731-128762649b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:40.665851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:40.666865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:40.669352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:40.669352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:40.669352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:40.669352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:40.672488 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 335/668] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:40.673299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8054f-8678-473c-a731-128762649b51 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:40.772065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ef528-3974-49d8-9e87-d4a6489741ac None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:40.783592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8054f-8678-473c-a731-128762649b51 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:40.802710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:40.811656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175778f-fb38-4b9b-8c0c-97381d8ab5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:40.812439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175778f-fb38-4b9b-8c0c-97381d8ab5ad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:40.812798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175778f-fb38-4b9b-8c0c-97381d8ab5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:40.813148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175778f-fb38-4b9b-8c0c-97381d8ab5ad None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:40.814042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175778f-fb38-4b9b-8c0c-97381d8ab5ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:40.814426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175778f-fb38-4b9b-8c0c-97381d8ab5ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:40.815943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175778f-fb38-4b9b-8c0c-97381d8ab5ad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:40.825421 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:40.834248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 334/669] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:40.834248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175778f-fb38-4b9b-8c0c-97381d8ab5ad None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:40.842317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1174a-a3ac-4a09-8708-5954def41c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:40.843337 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1174a-a3ac-4a09-8708-5954def41c6d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:40.843811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1174a-a3ac-4a09-8708-5954def41c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:40.844258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1174a-a3ac-4a09-8708-5954def41c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:40.845167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1174a-a3ac-4a09-8708-5954def41c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:40.845699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1174a-a3ac-4a09-8708-5954def41c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:40.847299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1174a-a3ac-4a09-8708-5954def41c6d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:40.867394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 336/670] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:40.868303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1174a-a3ac-4a09-8708-5954def41c6d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:40.959247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175778f-fb38-4b9b-8c0c-97381d8ab5ad None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:40.989722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1174a-a3ac-4a09-8708-5954def41c6d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.000889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc717e-73e6-43f2-b4c2-a9cf82cd4f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.001914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc717e-73e6-43f2-b4c2-a9cf82cd4f05 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.002214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc717e-73e6-43f2-b4c2-a9cf82cd4f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.002495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc717e-73e6-43f2-b4c2-a9cf82cd4f05 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.003211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc717e-73e6-43f2-b4c2-a9cf82cd4f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:41.003616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc717e-73e6-43f2-b4c2-a9cf82cd4f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:41.005057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc717e-73e6-43f2-b4c2-a9cf82cd4f05 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:41.025066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 335/671] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:41.025066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc717e-73e6-43f2-b4c2-a9cf82cd4f05 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:41.032710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdca38-3885-49c2-813c-6524228764ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.033575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdca38-3885-49c2-813c-6524228764ea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.033866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdca38-3885-49c2-813c-6524228764ea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.034146 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdca38-3885-49c2-813c-6524228764ea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.034815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdca38-3885-49c2-813c-6524228764ea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:41.036214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdca38-3885-49c2-813c-6524228764ea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e1fdca38-3885-49c2-813c-6524228764ea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:41.052779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:41.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:41.055127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 337/672] 10.222.0.90 () {56 vars in 1129 bytes} [Tue Jun 21 15:00:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:41.055995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdca38-3885-49c2-813c-6524228764ea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:41.102234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:41.106377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:41.157912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc717e-73e6-43f2-b4c2-a9cf82cd4f05 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.174096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdca38-3885-49c2-813c-6524228764ea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.199915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727ccc0-b834-480b-969f-a4c492270f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.200580 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727ccc0-b834-480b-969f-a4c492270f5b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.200864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727ccc0-b834-480b-969f-a4c492270f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.201143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727ccc0-b834-480b-969f-a4c492270f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.202176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727ccc0-b834-480b-969f-a4c492270f5b None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=2bd3ffc0a30648139b2cbf19bb6bd535) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:41.202176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727ccc0-b834-480b-969f-a4c492270f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:41.204245 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727ccc0-b834-480b-969f-a4c492270f5b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:41.209781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab08d22-726b-4e98-9fe1-8251d0ced9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.210335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 336/673] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/role_assignments?user.id=2bd3ffc0a30648139b2cbf19bb6bd535&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:41.210621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab08d22-726b-4e98-9fe1-8251d0ced9bc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.210948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab08d22-726b-4e98-9fe1-8251d0ced9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.211143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727ccc0-b834-480b-969f-a4c492270f5b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:41.211240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab08d22-726b-4e98-9fe1-8251d0ced9bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.234114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab08d22-726b-4e98-9fe1-8251d0ced9bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:41.235633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab08d22-726b-4e98-9fe1-8251d0ced9bc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-dab08d22-726b-4e98-9fe1-8251d0ced9bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:41.251898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:41.252904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 338/674] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:41.254434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab08d22-726b-4e98-9fe1-8251d0ced9bc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:41.349092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727ccc0-b834-480b-969f-a4c492270f5b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.376450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:41.377503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:41.381759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab08d22-726b-4e98-9fe1-8251d0ced9bc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.394349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131474-44a1-4750-810a-b56256e9b2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.395476 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131474-44a1-4750-810a-b56256e9b2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.395870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131474-44a1-4750-810a-b56256e9b2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.396260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec131474-44a1-4750-810a-b56256e9b2c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.407999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec131474-44a1-4750-810a-b56256e9b2c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:41.410145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec131474-44a1-4750-810a-b56256e9b2c4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:41.424133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08ebdb-a6c5-4f01-a565-18a2660db28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.424799 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ebdb-a6c5-4f01-a565-18a2660db28c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.425091 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ebdb-a6c5-4f01-a565-18a2660db28c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.425364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08ebdb-a6c5-4f01-a565-18a2660db28c None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.426106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08ebdb-a6c5-4f01-a565-18a2660db28c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:41.427142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08ebdb-a6c5-4f01-a565-18a2660db28c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:41.428513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08ebdb-a6c5-4f01-a565-18a2660db28c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:41.433392 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 339/675] 10.222.0.90 () {56 vars in 1124 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ec131474-44a1-4750-810a-b56256e9b2c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:41.434396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:41.435458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:41.436372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:41.436372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:41.436372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:41.436372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:41.436372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:41.436372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:41.436372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:41.436372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:41.436832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947eb8-a489-4b77-a332-bf243ee15c02 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.436832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947eb8-a489-4b77-a332-bf243ee15c02 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.436832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947eb8-a489-4b77-a332-bf243ee15c02 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.437028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 337/676] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:41.437681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 340/677] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:41.437858 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131474-44a1-4750-810a-b56256e9b2c4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:41.443746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eccf9-c3ef-49c7-bf6e-fd17f8e06da4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.444032 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eccf9-c3ef-49c7-bf6e-fd17f8e06da4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.444316 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eccf9-c3ef-49c7-bf6e-fd17f8e06da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.468022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-780eccf9-c3ef-49c7-bf6e-fd17f8e06da4 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:41.469173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-780eccf9-c3ef-49c7-bf6e-fd17f8e06da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:41.549040 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 341/678] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:41.554680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eccf9-c3ef-49c7-bf6e-fd17f8e06da4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:41.561290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec131474-44a1-4750-810a-b56256e9b2c4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.599699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3af99-4fc0-4f9c-844d-a8e33ac4a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.600365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3af99-4fc0-4f9c-844d-a8e33ac4a4cf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.600654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3af99-4fc0-4f9c-844d-a8e33ac4a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.600931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3af99-4fc0-4f9c-844d-a8e33ac4a4cf None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.601755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3af99-4fc0-4f9c-844d-a8e33ac4a4cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:41.602070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3af99-4fc0-4f9c-844d-a8e33ac4a4cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:41.603508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3af99-4fc0-4f9c-844d-a8e33ac4a4cf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:41.616932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 338/679] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:41.617801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3af99-4fc0-4f9c-844d-a8e33ac4a4cf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:41.670651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:41.673924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:41.682800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780eccf9-c3ef-49c7-bf6e-fd17f8e06da4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.724830 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d44b4-31e1-479b-bfc4-ed9456e03491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.725560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d44b4-31e1-479b-bfc4-ed9456e03491 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.725850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d44b4-31e1-479b-bfc4-ed9456e03491 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.726130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d44b4-31e1-479b-bfc4-ed9456e03491 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.726843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d44b4-31e1-479b-bfc4-ed9456e03491 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:41.727151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d44b4-31e1-479b-bfc4-ed9456e03491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:41.728767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d44b4-31e1-479b-bfc4-ed9456e03491 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:41.731241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3af99-4fc0-4f9c-844d-a8e33ac4a4cf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.745525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 342/680] 10.222.0.90 () {56 vars in 1124 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:41.745525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d44b4-31e1-479b-bfc4-ed9456e03491 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:41.780109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159940d-efd3-43aa-b83b-26da8dd008d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.780953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159940d-efd3-43aa-b83b-26da8dd008d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.781310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159940d-efd3-43aa-b83b-26da8dd008d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.781696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159940d-efd3-43aa-b83b-26da8dd008d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.782558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159940d-efd3-43aa-b83b-26da8dd008d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:41.782876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159940d-efd3-43aa-b83b-26da8dd008d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:41.784347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159940d-efd3-43aa-b83b-26da8dd008d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:41.802945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 339/681] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:41.802945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159940d-efd3-43aa-b83b-26da8dd008d6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:41.884845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d44b4-31e1-479b-bfc4-ed9456e03491 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.947399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a3885-fa56-48c2-b4f5-7a4629d62e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:41.948472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a3885-fa56-48c2-b4f5-7a4629d62e2e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:41.948959 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a3885-fa56-48c2-b4f5-7a4629d62e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:41.949574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a3885-fa56-48c2-b4f5-7a4629d62e2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:41.952254 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159940d-efd3-43aa-b83b-26da8dd008d6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:41.956985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:41.968187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a3885-fa56-48c2-b4f5-7a4629d62e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-530a3885-fa56-48c2-b4f5-7a4629d62e2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:41.977572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:41.978913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:41.980207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:41.983640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 343/682] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:41.984960 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a3885-fa56-48c2-b4f5-7a4629d62e2e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:42.001761 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59d5a-1b38-468f-8276-cc92411b557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:42.003285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59d5a-1b38-468f-8276-cc92411b557c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:42.004194 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59d5a-1b38-468f-8276-cc92411b557c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:42.004822 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59d5a-1b38-468f-8276-cc92411b557c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:42.006113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59d5a-1b38-468f-8276-cc92411b557c None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=27ac2738bf434afabe3d227dc5e52650) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:42.006624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59d5a-1b38-468f-8276-cc92411b557c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:42.007920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:42.009034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59d5a-1b38-468f-8276-cc92411b557c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:42.026071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 340/683] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/role_assignments?user.id=27ac2738bf434afabe3d227dc5e52650&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:42.026071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59d5a-1b38-468f-8276-cc92411b557c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:42.174812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59d5a-1b38-468f-8276-cc92411b557c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:42.198065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a3885-fa56-48c2-b4f5-7a4629d62e2e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:42.239347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07cb51-f793-4497-b6c3-526a57dea4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:42.239982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07cb51-f793-4497-b6c3-526a57dea4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:42.240268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07cb51-f793-4497-b6c3-526a57dea4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:42.240546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07cb51-f793-4497-b6c3-526a57dea4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:42.241350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07cb51-f793-4497-b6c3-526a57dea4a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:42.241957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07cb51-f793-4497-b6c3-526a57dea4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:42.243120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07cb51-f793-4497-b6c3-526a57dea4a4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:42.250108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308fbc4-3ab2-4bc4-a73d-1ccc7589480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:42.251157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308fbc4-3ab2-4bc4-a73d-1ccc7589480f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:42.251692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308fbc4-3ab2-4bc4-a73d-1ccc7589480f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:42.252201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308fbc4-3ab2-4bc4-a73d-1ccc7589480f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:42.253376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308fbc4-3ab2-4bc4-a73d-1ccc7589480f None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=08b3093a7415419cbb6d50701b09b7e8) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:42.253939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308fbc4-3ab2-4bc4-a73d-1ccc7589480f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:42.255724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308fbc4-3ab2-4bc4-a73d-1ccc7589480f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:42.261609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 341/684] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:42.264702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 344/685] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:41 2022] GET /identity/v3/role_assignments?user.id=08b3093a7415419cbb6d50701b09b7e8&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:42.268505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07cb51-f793-4497-b6c3-526a57dea4a4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:42.312773 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:42.406722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07cb51-f793-4497-b6c3-526a57dea4a4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:42.451729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36520e76-1d9c-46df-8bca-afcd88e2f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:42.452986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36520e76-1d9c-46df-8bca-afcd88e2f873 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:42.453800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36520e76-1d9c-46df-8bca-afcd88e2f873 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:42.454595 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36520e76-1d9c-46df-8bca-afcd88e2f873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:42.472371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36520e76-1d9c-46df-8bca-afcd88e2f873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:42.474149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36520e76-1d9c-46df-8bca-afcd88e2f873 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-36520e76-1d9c-46df-8bca-afcd88e2f873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:42.494043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:42.495275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:42.497068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:42.497068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:42.497068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:42.497068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:42.499380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 342/686] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:42.504840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308fbc4-3ab2-4bc4-a73d-1ccc7589480f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:42.603555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:42.629029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308fbc4-3ab2-4bc4-a73d-1ccc7589480f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:42.670168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861e6b-25cc-473d-a535-19d88da56fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:42.670860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861e6b-25cc-473d-a535-19d88da56fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:42.671146 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861e6b-25cc-473d-a535-19d88da56fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:42.671427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861e6b-25cc-473d-a535-19d88da56fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:42.672178 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9861e6b-25cc-473d-a535-19d88da56fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:42.672495 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9861e6b-25cc-473d-a535-19d88da56fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:42.673987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9861e6b-25cc-473d-a535-19d88da56fa1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:42.688806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 345/687] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:42.694765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36520e76-1d9c-46df-8bca-afcd88e2f873 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:42.815234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:42.842205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36520e76-1d9c-46df-8bca-afcd88e2f873 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:42.893136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85d9da-6241-4d07-bb1c-6e4176abef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:42.894123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85d9da-6241-4d07-bb1c-6e4176abef07 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:42.894444 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85d9da-6241-4d07-bb1c-6e4176abef07 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:42.894727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85d9da-6241-4d07-bb1c-6e4176abef07 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:42.909000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85d9da-6241-4d07-bb1c-6e4176abef07 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:42.910496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85d9da-6241-4d07-bb1c-6e4176abef07 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-be85d9da-6241-4d07-bb1c-6e4176abef07 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:42.938825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:42.939799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:42.940791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 343/688] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:42.951292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861e6b-25cc-473d-a535-19d88da56fa1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:43.076277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861e6b-25cc-473d-a535-19d88da56fa1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:43.130303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cebc5-4415-40cf-9f30-2d910fa84655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:43.131270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cebc5-4415-40cf-9f30-2d910fa84655 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:43.131701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cebc5-4415-40cf-9f30-2d910fa84655 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:43.132111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cebc5-4415-40cf-9f30-2d910fa84655 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:43.133391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cebc5-4415-40cf-9f30-2d910fa84655 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:43.133884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cebc5-4415-40cf-9f30-2d910fa84655 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:43.137016 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cebc5-4415-40cf-9f30-2d910fa84655 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:43.168390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:43.181884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 346/689] 10.222.0.90 () {56 vars in 1135 bytes} [Tue Jun 21 15:00:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:43.184415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85d9da-6241-4d07-bb1c-6e4176abef07 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:43.359692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85d9da-6241-4d07-bb1c-6e4176abef07 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:43.406485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8cc09-dbaa-4214-8c08-bef94d5707ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:43.407152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8cc09-dbaa-4214-8c08-bef94d5707ff None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:43.407441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8cc09-dbaa-4214-8c08-bef94d5707ff None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:43.407724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8cc09-dbaa-4214-8c08-bef94d5707ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:43.433994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:43.514508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8cc09-dbaa-4214-8c08-bef94d5707ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:43.516078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8cc09-dbaa-4214-8c08-bef94d5707ff None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:43.630407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511cfdf-0e19-4892-bb26-f63128d6338d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:43.630584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511cfdf-0e19-4892-bb26-f63128d6338d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:43.630833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511cfdf-0e19-4892-bb26-f63128d6338d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:43.635988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 347/690] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:43.639052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07338c2c-4d1e-4aa1-8dd2-7bce8b4ca92f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:43.639416 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07338c2c-4d1e-4aa1-8dd2-7bce8b4ca92f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:43.639739 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07338c2c-4d1e-4aa1-8dd2-7bce8b4ca92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:43.658659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 344/691] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:43.666555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8cc09-dbaa-4214-8c08-bef94d5707ff None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:43.674051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-07338c2c-4d1e-4aa1-8dd2-7bce8b4ca92f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:43.675329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-07338c2c-4d1e-4aa1-8dd2-7bce8b4ca92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:43.745490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:43.809506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 348/692] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:43.849956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8cc09-dbaa-4214-8c08-bef94d5707ff None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:43.904569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07338c2c-4d1e-4aa1-8dd2-7bce8b4ca92f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:43.911656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dd417-948f-4aad-b974-64754c13a642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:43.912806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dd417-948f-4aad-b974-64754c13a642 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:43.913265 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dd417-948f-4aad-b974-64754c13a642 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:43.913756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dd417-948f-4aad-b974-64754c13a642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:43.927901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dd417-948f-4aad-b974-64754c13a642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:43.929977 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dd417-948f-4aad-b974-64754c13a642 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d81dd417-948f-4aad-b974-64754c13a642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:43.955891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:43.956895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:43.957933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:43.957933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:43.957933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:43.957933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:43.961583 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 345/693] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:43.962959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dd417-948f-4aad-b974-64754c13a642 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:44.074125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:44.080931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dd417-948f-4aad-b974-64754c13a642 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:44.118042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07338c2c-4d1e-4aa1-8dd2-7bce8b4ca92f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:44.119507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38829193-606b-451a-a35d-80bef0134963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:44.120295 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38829193-606b-451a-a35d-80bef0134963 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:44.120639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38829193-606b-451a-a35d-80bef0134963 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:44.121056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38829193-606b-451a-a35d-80bef0134963 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:44.122257 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38829193-606b-451a-a35d-80bef0134963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:44.122575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38829193-606b-451a-a35d-80bef0134963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:44.123981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38829193-606b-451a-a35d-80bef0134963 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:44.140935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 346/694] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:44.143111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38829193-606b-451a-a35d-80bef0134963 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:44.189961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:44.202402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b7782-645c-4349-8d62-f0a015cc13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:44.203222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b7782-645c-4349-8d62-f0a015cc13cb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:44.203514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b7782-645c-4349-8d62-f0a015cc13cb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:44.203797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b7782-645c-4349-8d62-f0a015cc13cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:44.251187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b7782-645c-4349-8d62-f0a015cc13cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:44.269589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38829193-606b-451a-a35d-80bef0134963 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4d2b7782-645c-4349-8d62-f0a015cc13cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:44.271156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:44.272171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:44.273047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:44.278102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 349/695] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:44.284319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b7782-645c-4349-8d62-f0a015cc13cb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:44.313883 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a2b51-b8d4-4b53-81b3-5e9801752ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:44.314736 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a2b51-b8d4-4b53-81b3-5e9801752ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:44.315023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a2b51-b8d4-4b53-81b3-5e9801752ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:44.315350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a2b51-b8d4-4b53-81b3-5e9801752ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:44.323992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a2b51-b8d4-4b53-81b3-5e9801752ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:44.326183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a2b51-b8d4-4b53-81b3-5e9801752ba2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-999a2b51-b8d4-4b53-81b3-5e9801752ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:44.343952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:44.346808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:44.349755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:44.349755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:44.349755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:44.349755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:44.349755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:44.349755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:44.349755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:44.349755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:44.351105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 347/696] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:44.353742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a2b51-b8d4-4b53-81b3-5e9801752ba2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:44.374739 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:44.483740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a2b51-b8d4-4b53-81b3-5e9801752ba2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:44.529228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d82e7f-6342-4cbe-8dcc-05f984bd3f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:44.530230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d82e7f-6342-4cbe-8dcc-05f984bd3f88 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:44.531077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d82e7f-6342-4cbe-8dcc-05f984bd3f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:44.531372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d82e7f-6342-4cbe-8dcc-05f984bd3f88 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:44.532487 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d82e7f-6342-4cbe-8dcc-05f984bd3f88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:44.532813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d82e7f-6342-4cbe-8dcc-05f984bd3f88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:44.534571 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d82e7f-6342-4cbe-8dcc-05f984bd3f88 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:44.553562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 348/697] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:44.555248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc9ff0-626c-479e-95ec-21b779c49695 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:44.555742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc9ff0-626c-479e-95ec-21b779c49695 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:44.556240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc9ff0-626c-479e-95ec-21b779c49695 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:44.559217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 349/698] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:44.564644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc9ff0-626c-479e-95ec-21b779c49695 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:44.567848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b7782-645c-4349-8d62-f0a015cc13cb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:44.605465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3a0d0-ca4e-4247-8b38-c6ca753b90d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:44.606643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a0d0-ca4e-4247-8b38-c6ca753b90d3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:44.607133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a0d0-ca4e-4247-8b38-c6ca753b90d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:44.607633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a0d0-ca4e-4247-8b38-c6ca753b90d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:44.608593 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3a0d0-ca4e-4247-8b38-c6ca753b90d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:44.609098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3a0d0-ca4e-4247-8b38-c6ca753b90d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:44.610781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3a0d0-ca4e-4247-8b38-c6ca753b90d3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:44.628163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 350/699] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:44.630446 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb6204-1c41-4caf-a8a5-57be63c42b3b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:44.630803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb6204-1c41-4caf-a8a5-57be63c42b3b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:44.631148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb6204-1c41-4caf-a8a5-57be63c42b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:44.657766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-33bb6204-1c41-4caf-a8a5-57be63c42b3b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:44.659086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-33bb6204-1c41-4caf-a8a5-57be63c42b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:44.663909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:44.693638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc9ff0-626c-479e-95ec-21b779c49695 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:44.724810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:44.733829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824894-0b9a-4335-a7f8-54443e546034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:44.734795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824894-0b9a-4335-a7f8-54443e546034 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:44.735387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824894-0b9a-4335-a7f8-54443e546034 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:44.735890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824894-0b9a-4335-a7f8-54443e546034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:44.737125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8824894-0b9a-4335-a7f8-54443e546034 None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=8ebffb0a0cf04bc0809a94ddd3a347b9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:44.737682 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8824894-0b9a-4335-a7f8-54443e546034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:44.739450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8824894-0b9a-4335-a7f8-54443e546034 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:44.747633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 350/700] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:44 2022] GET /identity/v3/role_assignments?user.id=8ebffb0a0cf04bc0809a94ddd3a347b9&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:44.748906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824894-0b9a-4335-a7f8-54443e546034 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:44.757643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 351/701] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:44.777631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb6204-1c41-4caf-a8a5-57be63c42b3b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:44.913049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824894-0b9a-4335-a7f8-54443e546034 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:44.978480 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a89c-4c31-477f-a48a-3ace0fa869cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:44.979698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a89c-4c31-477f-a48a-3ace0fa869cb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:44.980377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a89c-4c31-477f-a48a-3ace0fa869cb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:44.980879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a89c-4c31-477f-a48a-3ace0fa869cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.007180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a89c-4c31-477f-a48a-3ace0fa869cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:45.007773 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:45.014840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a89c-4c31-477f-a48a-3ace0fa869cb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:45.038201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb6204-1c41-4caf-a8a5-57be63c42b3b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8f33a89c-4c31-477f-a48a-3ace0fa869cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:45.039120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:45.040015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:45.040937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:45.040937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:45.040937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:45.040937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:45.041932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 351/702] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:45.049796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a89c-4c31-477f-a48a-3ace0fa869cb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:45.094133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca3c31-09cf-4574-82a5-73829cec0db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:45.095142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca3c31-09cf-4574-82a5-73829cec0db4 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.095855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca3c31-09cf-4574-82a5-73829cec0db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.096499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca3c31-09cf-4574-82a5-73829cec0db4 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.097369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca3c31-09cf-4574-82a5-73829cec0db4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:45.099088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca3c31-09cf-4574-82a5-73829cec0db4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:45.125441 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 352/703] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:00:44 2022] POST /identity/v3/services => generated 251 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:00:45.151067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1240227-2f8a-4450-9e4d-57a2f770c94c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.151536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1240227-2f8a-4450-9e4d-57a2f770c94c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.152509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1240227-2f8a-4450-9e4d-57a2f770c94c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.155382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 353/704] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:00:45.160690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6c6c-7aeb-492a-8eb2-aec77bc21f87 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.160997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6c6c-7aeb-492a-8eb2-aec77bc21f87 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.163025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6c6c-7aeb-492a-8eb2-aec77bc21f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.192485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-822f6c6c-7aeb-492a-8eb2-aec77bc21f87 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:45.194131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-822f6c6c-7aeb-492a-8eb2-aec77bc21f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:45.210659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a89c-4c31-477f-a48a-3ace0fa869cb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:45.266742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:45.267851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b203a-e0ce-48d9-a12c-5952788a2498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:45.268829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b203a-e0ce-48d9-a12c-5952788a2498 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.269256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b203a-e0ce-48d9-a12c-5952788a2498 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.269616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b203a-e0ce-48d9-a12c-5952788a2498 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.270392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b203a-e0ce-48d9-a12c-5952788a2498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:45.270944 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b203a-e0ce-48d9-a12c-5952788a2498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:45.272668 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b203a-e0ce-48d9-a12c-5952788a2498 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:45.298860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 352/705] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:45.301799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900c4b2-7c8a-4e30-a270-fc81d35ca092 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.302381 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900c4b2-7c8a-4e30-a270-fc81d35ca092 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.302856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900c4b2-7c8a-4e30-a270-fc81d35ca092 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.306339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 353/706] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:45.307848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900c4b2-7c8a-4e30-a270-fc81d35ca092 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:45.336243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 354/707] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:00:45.338861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b346-bc51-4c86-912f-7ce3e051438c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.339338 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b346-bc51-4c86-912f-7ce3e051438c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.340003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b346-bc51-4c86-912f-7ce3e051438c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.377418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-df70b346-bc51-4c86-912f-7ce3e051438c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:45.378635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:45.380238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-df70b346-bc51-4c86-912f-7ce3e051438c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:45.454621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900c4b2-7c8a-4e30-a270-fc81d35ca092 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:45.478320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 355/708] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:45.479257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b346-bc51-4c86-912f-7ce3e051438c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:45.516083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936276dc-45ce-438d-b696-258756d87a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:45.516970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936276dc-45ce-438d-b696-258756d87a74 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.517249 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936276dc-45ce-438d-b696-258756d87a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.517590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936276dc-45ce-438d-b696-258756d87a74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.528850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936276dc-45ce-438d-b696-258756d87a74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:45.530802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936276dc-45ce-438d-b696-258756d87a74 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-936276dc-45ce-438d-b696-258756d87a74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:45.548788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:45.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:45.551395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 354/709] 10.222.0.90 () {56 vars in 1093 bytes} [Tue Jun 21 15:00:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:45.552004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936276dc-45ce-438d-b696-258756d87a74 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:45.612401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b346-bc51-4c86-912f-7ce3e051438c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:45.617521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:45.653769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8bd06-5ccd-4672-9c75-8d4293905a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:45.654927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8bd06-5ccd-4672-9c75-8d4293905a74 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.655399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8bd06-5ccd-4672-9c75-8d4293905a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.655855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8bd06-5ccd-4672-9c75-8d4293905a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.668056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8bd06-5ccd-4672-9c75-8d4293905a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:45.670100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8bd06-5ccd-4672-9c75-8d4293905a74 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:45.677181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936276dc-45ce-438d-b696-258756d87a74 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:45.686064 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3cb8bd06-5ccd-4672-9c75-8d4293905a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:45.691125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:45.692024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:45.692940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:45.692940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:45.692940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:45.692940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:45.695111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 356/710] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:45.696097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8bd06-5ccd-4672-9c75-8d4293905a74 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:45.727084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4ee7-0f25-48e5-8404-226a9a02b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:45.728209 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4ee7-0f25-48e5-8404-226a9a02b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.728694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4ee7-0f25-48e5-8404-226a9a02b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.729148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c4ee7-0f25-48e5-8404-226a9a02b7c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.730599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c4ee7-0f25-48e5-8404-226a9a02b7c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:45.732645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c4ee7-0f25-48e5-8404-226a9a02b7c9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0c3c4ee7-0f25-48e5-8404-226a9a02b7c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:45.751591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:45.752735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:00:45.753664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:45.758275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 355/711] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:45 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:45.759004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4ee7-0f25-48e5-8404-226a9a02b7c9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:45.824424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8bd06-5ccd-4672-9c75-8d4293905a74 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:45.862799 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093c563-50cf-4945-babf-cf82365e92a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:45.863833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c563-50cf-4945-babf-cf82365e92a8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.864300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c563-50cf-4945-babf-cf82365e92a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.864758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c563-50cf-4945-babf-cf82365e92a8 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.865834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093c563-50cf-4945-babf-cf82365e92a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:45.866345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093c563-50cf-4945-babf-cf82365e92a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:45.867981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093c563-50cf-4945-babf-cf82365e92a8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:45.886084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c4ee7-0f25-48e5-8404-226a9a02b7c9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:45.893400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 357/712] 10.222.0.90 () {56 vars in 1133 bytes} [Tue Jun 21 15:00:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:45.894647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093c563-50cf-4945-babf-cf82365e92a8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:45.910044 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:45.932117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f9a32-d6e4-4c15-84ce-fd791a20f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:45.932841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f9a32-d6e4-4c15-84ce-fd791a20f6ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:45.933368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f9a32-d6e4-4c15-84ce-fd791a20f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:45.933878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f9a32-d6e4-4c15-84ce-fd791a20f6ba None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:45.934840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f9a32-d6e4-4c15-84ce-fd791a20f6ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:45.935207 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f9a32-d6e4-4c15-84ce-fd791a20f6ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:45.936997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f9a32-d6e4-4c15-84ce-fd791a20f6ba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:45.957827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 356/713] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:45.958897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f9a32-d6e4-4c15-84ce-fd791a20f6ba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:45.996575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:46.019667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093c563-50cf-4945-babf-cf82365e92a8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:46.061027 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7eba9-1b59-44c7-a0dd-731cc3e9ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:46.061957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7eba9-1b59-44c7-a0dd-731cc3e9ec83 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:46.062753 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7eba9-1b59-44c7-a0dd-731cc3e9ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:46.062896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7eba9-1b59-44c7-a0dd-731cc3e9ec83 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:46.063844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7eba9-1b59-44c7-a0dd-731cc3e9ec83 None admin] RBAC: Adding query filter params (name=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:46.064277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7eba9-1b59-44c7-a0dd-731cc3e9ec83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:46.065834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7eba9-1b59-44c7-a0dd-731cc3e9ec83 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:46.072156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 358/714] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:00:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:46.078604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7eba9-1b59-44c7-a0dd-731cc3e9ec83 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:46.093697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f9a32-d6e4-4c15-84ce-fd791a20f6ba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:46.138960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ac5f6-572f-4813-b0a2-49590df44ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:46.140044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ac5f6-572f-4813-b0a2-49590df44ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:46.140564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ac5f6-572f-4813-b0a2-49590df44ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:46.141210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ac5f6-572f-4813-b0a2-49590df44ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:46.161763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:46.187543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7eba9-1b59-44c7-a0dd-731cc3e9ec83 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:46.223367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521ecc5-6ac0-4933-aca6-e368f13ca6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:46.224033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ecc5-6ac0-4933-aca6-e368f13ca6ca None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:46.224358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ecc5-6ac0-4933-aca6-e368f13ca6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:46.224623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ecc5-6ac0-4933-aca6-e368f13ca6ca None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:46.225357 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521ecc5-6ac0-4933-aca6-e368f13ca6ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:46.226905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521ecc5-6ac0-4933-aca6-e368f13ca6ca None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:46.231865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ac5f6-572f-4813-b0a2-49590df44ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:46.233851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ac5f6-572f-4813-b0a2-49590df44ae9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:46.257497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 359/715] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:00:46 2022] POST /identity/v3/users => generated 254 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:00:46.257497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521ecc5-6ac0-4933-aca6-e368f13ca6ca None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:46.316696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:46.447834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521ecc5-6ac0-4933-aca6-e368f13ca6ca None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:46.480237 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 357/716] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:45 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:46.486688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ac5f6-572f-4813-b0a2-49590df44ae9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:46.499621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:46.516232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6956fd9-a61c-4bbf-a980-ffa3ee07604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:46.517272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6956fd9-a61c-4bbf-a980-ffa3ee07604e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:46.517832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6956fd9-a61c-4bbf-a980-ffa3ee07604e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:46.518546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6956fd9-a61c-4bbf-a980-ffa3ee07604e None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:46.519889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6956fd9-a61c-4bbf-a980-ffa3ee07604e None admin] RBAC: Adding query filter params (type=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:46.520602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6956fd9-a61c-4bbf-a980-ffa3ee07604e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:46.522511 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6956fd9-a61c-4bbf-a980-ffa3ee07604e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:46.532142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 360/717] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:00:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:46.616417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ac5f6-572f-4813-b0a2-49590df44ae9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:46.653087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:46.660096 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f5f14-7957-4535-b0b6-6d544a0c41f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:46.661419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f5f14-7957-4535-b0b6-6d544a0c41f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:46.662023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f5f14-7957-4535-b0b6-6d544a0c41f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:46.662672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f5f14-7957-4535-b0b6-6d544a0c41f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:46.676577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f5f14-7957-4535-b0b6-6d544a0c41f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:46.678854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f5f14-7957-4535-b0b6-6d544a0c41f6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0d7f5f14-7957-4535-b0b6-6d544a0c41f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:46.702799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:46.703837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:46.704848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:46.704848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:46.704848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:46.704848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:46.704848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 358/718] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:46.709968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6956fd9-a61c-4bbf-a980-ffa3ee07604e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:46.856970 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6956fd9-a61c-4bbf-a980-ffa3ee07604e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:46.900385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38ed9-1ad0-44d7-a7af-1bcf5241a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:46.901404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38ed9-1ad0-44d7-a7af-1bcf5241a542 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:46.902560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38ed9-1ad0-44d7-a7af-1bcf5241a542 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:46.903275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38ed9-1ad0-44d7-a7af-1bcf5241a542 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:46.904210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38ed9-1ad0-44d7-a7af-1bcf5241a542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:46.904708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38ed9-1ad0-44d7-a7af-1bcf5241a542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:46.906305 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38ed9-1ad0-44d7-a7af-1bcf5241a542 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:46.931169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 361/719] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:46.936956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f5f14-7957-4535-b0b6-6d544a0c41f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:47.100466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f5f14-7957-4535-b0b6-6d544a0c41f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:47.153755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b64aa-b907-4b4c-b4c5-d495a9dd2895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:47.154562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b64aa-b907-4b4c-b4c5-d495a9dd2895 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:47.154843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b64aa-b907-4b4c-b4c5-d495a9dd2895 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:47.155116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b64aa-b907-4b4c-b4c5-d495a9dd2895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:47.162526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b64aa-b907-4b4c-b4c5-d495a9dd2895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:47.164006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b64aa-b907-4b4c-b4c5-d495a9dd2895 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7c9b64aa-b907-4b4c-b4c5-d495a9dd2895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:47.183358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:47.184521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:47.185509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:47.185509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:47.185509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:47.185509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:47.185509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:47.185509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:47.185509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:47.185509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:47.185509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 359/720] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:47.190723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38ed9-1ad0-44d7-a7af-1bcf5241a542 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:47.275714 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:47.335910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38ed9-1ad0-44d7-a7af-1bcf5241a542 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:47.376094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fdfad-6383-4a87-b133-871b9d32da39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:47.376688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fdfad-6383-4a87-b133-871b9d32da39 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:47.376980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fdfad-6383-4a87-b133-871b9d32da39 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:47.377263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fdfad-6383-4a87-b133-871b9d32da39 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:47.378088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fdfad-6383-4a87-b133-871b9d32da39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:47.378401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fdfad-6383-4a87-b133-871b9d32da39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:47.379832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fdfad-6383-4a87-b133-871b9d32da39 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:47.393630 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 362/721] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:47.403390 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b64aa-b907-4b4c-b4c5-d495a9dd2895 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:47.456161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:47.471029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b612-0404-4a4a-b29d-0adc187d6143 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:47.471573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b612-0404-4a4a-b29d-0adc187d6143 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:47.471947 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b612-0404-4a4a-b29d-0adc187d6143 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:47.473645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 363/722] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:47.483472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87357cb-be19-435e-9b73-d23b0fb81bb6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:47.483771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87357cb-be19-435e-9b73-d23b0fb81bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:47.484054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87357cb-be19-435e-9b73-d23b0fb81bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:47.504724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f87357cb-be19-435e-9b73-d23b0fb81bb6 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:47.505979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f87357cb-be19-435e-9b73-d23b0fb81bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:47.571088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b64aa-b907-4b4c-b4c5-d495a9dd2895 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:47.628049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 364/723] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 15:00:47.644239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567f5ee-1c54-49d6-90d3-3eac5940f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:47.644963 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567f5ee-1c54-49d6-90d3-3eac5940f9ab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:47.645254 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567f5ee-1c54-49d6-90d3-3eac5940f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:47.645557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567f5ee-1c54-49d6-90d3-3eac5940f9ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:47.646408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567f5ee-1c54-49d6-90d3-3eac5940f9ab None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=2bd3ffc0a30648139b2cbf19bb6bd535) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:47.646734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567f5ee-1c54-49d6-90d3-3eac5940f9ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:47.648188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567f5ee-1c54-49d6-90d3-3eac5940f9ab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:47.655923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 360/724] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:47 2022] GET /identity/v3/role_assignments?user.id=2bd3ffc0a30648139b2cbf19bb6bd535&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:47.683167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87357cb-be19-435e-9b73-d23b0fb81bb6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:47.758219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:47.836536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87357cb-be19-435e-9b73-d23b0fb81bb6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:47.859558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4cf0-3ae7-4509-bfeb-27b36ccea6b0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:47.859937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4cf0-3ae7-4509-bfeb-27b36ccea6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:47.860238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4cf0-3ae7-4509-bfeb-27b36ccea6b0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:47.862788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 361/725] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:47.866886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de501df0-9847-4879-bc2d-afd401574c22 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:47.867225 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de501df0-9847-4879-bc2d-afd401574c22 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:47.867556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de501df0-9847-4879-bc2d-afd401574c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:47.879537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39986a97-a1a0-400e-b62f-e6bf7737b7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:47.880272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39986a97-a1a0-400e-b62f-e6bf7737b7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:47.880560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39986a97-a1a0-400e-b62f-e6bf7737b7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:47.880841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39986a97-a1a0-400e-b62f-e6bf7737b7b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:47.895260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39986a97-a1a0-400e-b62f-e6bf7737b7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-39986a97-a1a0-400e-b62f-e6bf7737b7b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:47.905276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:47.906340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:47.907208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:47.908372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-de501df0-9847-4879-bc2d-afd401574c22 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:47.908465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 365/726] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:47.908539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-de501df0-9847-4879-bc2d-afd401574c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:47.916636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39986a97-a1a0-400e-b62f-e6bf7737b7b0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:48.035749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 362/727] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:48.073228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de501df0-9847-4879-bc2d-afd401574c22 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:48.091997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39986a97-a1a0-400e-b62f-e6bf7737b7b0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:48.102863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:48.138167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:48.160117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a4af9-f478-4049-877b-1abd177b5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:48.160796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a4af9-f478-4049-877b-1abd177b5f91 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:48.161081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a4af9-f478-4049-877b-1abd177b5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:48.161362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a4af9-f478-4049-877b-1abd177b5f91 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:48.162142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a4af9-f478-4049-877b-1abd177b5f91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:48.162453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a4af9-f478-4049-877b-1abd177b5f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:48.163864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a4af9-f478-4049-877b-1abd177b5f91 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:48.178075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 366/728] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:48.183762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a4af9-f478-4049-877b-1abd177b5f91 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:48.248205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de501df0-9847-4879-bc2d-afd401574c22 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:48.317704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d3daa-780e-4279-894f-feaa18ae28ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:48.318526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d3daa-780e-4279-894f-feaa18ae28ec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:48.318814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d3daa-780e-4279-894f-feaa18ae28ec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:48.319090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d3daa-780e-4279-894f-feaa18ae28ec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:48.319753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d3daa-780e-4279-894f-feaa18ae28ec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:48.321130 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d3daa-780e-4279-894f-feaa18ae28ec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a13d3daa-780e-4279-894f-feaa18ae28ec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:48.340609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:48.341663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:00:48.342576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:48.345874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 363/729] 10.222.0.90 () {56 vars in 1129 bytes} [Tue Jun 21 15:00:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:48.350721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a4af9-f478-4049-877b-1abd177b5f91 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:48.353037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d3daa-780e-4279-894f-feaa18ae28ec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:48.421680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2d329-086e-4ef2-a1a1-289b811b494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:48.422405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2d329-086e-4ef2-a1a1-289b811b494d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:48.422692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2d329-086e-4ef2-a1a1-289b811b494d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:48.422972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2d329-086e-4ef2-a1a1-289b811b494d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:48.448172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2d329-086e-4ef2-a1a1-289b811b494d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:48.450736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2d329-086e-4ef2-a1a1-289b811b494d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a4a2d329-086e-4ef2-a1a1-289b811b494d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:48.485500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:48.486514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:48.487476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:48.487476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:48.487476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:48.487476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:48.490206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 367/730] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:48.496464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:48.497737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2d329-086e-4ef2-a1a1-289b811b494d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:48.500176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d3daa-780e-4279-894f-feaa18ae28ec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:48.539397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f5f9b-7293-4997-bf4f-aff834c049a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:48.540087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f5f9b-7293-4997-bf4f-aff834c049a8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:48.540355 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f5f9b-7293-4997-bf4f-aff834c049a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:48.540637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f5f9b-7293-4997-bf4f-aff834c049a8 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:48.541350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f5f9b-7293-4997-bf4f-aff834c049a8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:48.541691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f5f9b-7293-4997-bf4f-aff834c049a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:48.543418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:48.545681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f5f9b-7293-4997-bf4f-aff834c049a8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:48.552113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 364/731] 10.222.0.90 () {56 vars in 1124 bytes} [Tue Jun 21 15:00:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:48.559055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f5f9b-7293-4997-bf4f-aff834c049a8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:48.731315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2d329-086e-4ef2-a1a1-289b811b494d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:48.800418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc78b5-b543-4d63-99b6-ec0bb0d8a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:48.801858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc78b5-b543-4d63-99b6-ec0bb0d8a632 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:48.802345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc78b5-b543-4d63-99b6-ec0bb0d8a632 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:48.802848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc78b5-b543-4d63-99b6-ec0bb0d8a632 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:48.804228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc78b5-b543-4d63-99b6-ec0bb0d8a632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:48.804772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc78b5-b543-4d63-99b6-ec0bb0d8a632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:48.808035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc78b5-b543-4d63-99b6-ec0bb0d8a632 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:48.840069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 368/732] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:48.847031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc78b5-b543-4d63-99b6-ec0bb0d8a632 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:48.912317 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f5f9b-7293-4997-bf4f-aff834c049a8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:48.982998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b5624-be8d-4727-bec0-db643ce139ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:48.983601 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b5624-be8d-4727-bec0-db643ce139ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:48.983870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b5624-be8d-4727-bec0-db643ce139ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:48.984146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b5624-be8d-4727-bec0-db643ce139ba None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:48.984851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b5624-be8d-4727-bec0-db643ce139ba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:48.985164 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b5624-be8d-4727-bec0-db643ce139ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:48.986640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b5624-be8d-4727-bec0-db643ce139ba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:48.993304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 365/733] 10.222.0.90 () {56 vars in 1124 bytes} [Tue Jun 21 15:00:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:48.994653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb28b5-7374-490d-89c8-b04c4bd3b84a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:48.994944 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb28b5-7374-490d-89c8-b04c4bd3b84a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:48.995315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb28b5-7374-490d-89c8-b04c4bd3b84a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.001173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 366/734] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:49.001173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb28b5-7374-490d-89c8-b04c4bd3b84a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:49.003445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:49.032455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:49.034969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc78b5-b543-4d63-99b6-ec0bb0d8a632 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:49.086634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4cfc4-17c4-49b4-8724-8084c05c2121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:49.087433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4cfc4-17c4-49b4-8724-8084c05c2121 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.087712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4cfc4-17c4-49b4-8724-8084c05c2121 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.087985 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4cfc4-17c4-49b4-8724-8084c05c2121 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.099229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4cfc4-17c4-49b4-8724-8084c05c2121 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:49.101291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4cfc4-17c4-49b4-8724-8084c05c2121 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fdd4cfc4-17c4-49b4-8724-8084c05c2121 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:49.119138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:49.120556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:49.122433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:49.128817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 369/735] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:49.130367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c345ca-6573-47f1-9f50-aa19bb46ab7f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.130756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c345ca-6573-47f1-9f50-aa19bb46ab7f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.131133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c345ca-6573-47f1-9f50-aa19bb46ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.133604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb28b5-7374-490d-89c8-b04c4bd3b84a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:49.148730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-18c345ca-6573-47f1-9f50-aa19bb46ab7f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:49.150091 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-18c345ca-6573-47f1-9f50-aa19bb46ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:49.178790 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ac112-a9d5-48bc-8505-68f49f2abe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:49.179864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ac112-a9d5-48bc-8505-68f49f2abe02 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.180345 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ac112-a9d5-48bc-8505-68f49f2abe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.180816 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ac112-a9d5-48bc-8505-68f49f2abe02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.181838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ac112-a9d5-48bc-8505-68f49f2abe02 None admin] RBAC: Adding query filter params (interface=public, service_id=295c3ca280304cfbb61c1d335f42638a, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:49.182352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ac112-a9d5-48bc-8505-68f49f2abe02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:49.184879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ac112-a9d5-48bc-8505-68f49f2abe02 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:49.194623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 367/736] 10.222.0.90 () {56 vars in 1251 bytes} [Tue Jun 21 15:00:48 2022] GET /identity/v3/endpoints?service_id=295c3ca280304cfbb61c1d335f42638a&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:49.195913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ac112-a9d5-48bc-8505-68f49f2abe02 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:49.249573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 370/737] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:49.249573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c345ca-6573-47f1-9f50-aa19bb46ab7f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:49.332367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:49.334896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:49.345876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ac112-a9d5-48bc-8505-68f49f2abe02 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:49.374526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c345ca-6573-47f1-9f50-aa19bb46ab7f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:49.386108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d2d3e-ef26-45cf-92e2-02024d333d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:49.387758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d2d3e-ef26-45cf-92e2-02024d333d76 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.388375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d2d3e-ef26-45cf-92e2-02024d333d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.388946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d2d3e-ef26-45cf-92e2-02024d333d76 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.390328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d2d3e-ef26-45cf-92e2-02024d333d76 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:49.391055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d2d3e-ef26-45cf-92e2-02024d333d76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:49.392992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d2d3e-ef26-45cf-92e2-02024d333d76 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:49.414796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308bcdf-4756-475c-8f99-21c3d46df4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:49.415639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308bcdf-4756-475c-8f99-21c3d46df4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.415838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308bcdf-4756-475c-8f99-21c3d46df4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.416060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308bcdf-4756-475c-8f99-21c3d46df4c7 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.416462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 368/738] 10.222.0.90 () {56 vars in 1135 bytes} [Tue Jun 21 15:00:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:49.417916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d2d3e-ef26-45cf-92e2-02024d333d76 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:49.422228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308bcdf-4756-475c-8f99-21c3d46df4c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:49.423683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308bcdf-4756-475c-8f99-21c3d46df4c7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:49.430815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 371/739] 10.222.0.90 () {56 vars in 1087 bytes} [Tue Jun 21 15:00:49 2022] GET /identity/v3/services => generated 544 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:49.431738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308bcdf-4756-475c-8f99-21c3d46df4c7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:49.567833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d2d3e-ef26-45cf-92e2-02024d333d76 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:49.583678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308bcdf-4756-475c-8f99-21c3d46df4c7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:49.608190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25cacb-6547-4405-800e-af9241105b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:49.609024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25cacb-6547-4405-800e-af9241105b6a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.609281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25cacb-6547-4405-800e-af9241105b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.609589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25cacb-6547-4405-800e-af9241105b6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.622122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25cacb-6547-4405-800e-af9241105b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fe25cacb-6547-4405-800e-af9241105b6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:49.630547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:49.631596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:49.632660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:49.634319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a67b6-fc73-4523-8e88-5b8239fb20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:49.634871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 369/740] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:49.635465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a67b6-fc73-4523-8e88-5b8239fb20e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.635943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a67b6-fc73-4523-8e88-5b8239fb20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.636442 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84591-52fe-45ab-9ada-6822e0444e8a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.636638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a67b6-fc73-4523-8e88-5b8239fb20e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.636733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84591-52fe-45ab-9ada-6822e0444e8a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.636997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84591-52fe-45ab-9ada-6822e0444e8a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.638988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 370/741] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:49.639732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84591-52fe-45ab-9ada-6822e0444e8a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:49.641058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:49.658026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:49.735913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a67b6-fc73-4523-8e88-5b8239fb20e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:49.737694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a67b6-fc73-4523-8e88-5b8239fb20e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:49.788549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84591-52fe-45ab-9ada-6822e0444e8a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:49.836188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85648d24-4e62-40f7-9dc9-d7a69e5d9f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:49.837078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85648d24-4e62-40f7-9dc9-d7a69e5d9f6b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.837361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85648d24-4e62-40f7-9dc9-d7a69e5d9f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.837732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85648d24-4e62-40f7-9dc9-d7a69e5d9f6b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.838864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85648d24-4e62-40f7-9dc9-d7a69e5d9f6b None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:49.839547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85648d24-4e62-40f7-9dc9-d7a69e5d9f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:49.840989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85648d24-4e62-40f7-9dc9-d7a69e5d9f6b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:49.857420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 371/742] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:49.858900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643d5ee-19bd-48a7-b09c-266cc662bfc9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:49.859188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643d5ee-19bd-48a7-b09c-266cc662bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:49.859521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643d5ee-19bd-48a7-b09c-266cc662bfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:49.882837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d643d5ee-19bd-48a7-b09c-266cc662bfc9 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:49.884318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d643d5ee-19bd-48a7-b09c-266cc662bfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:49.906904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 372/743] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:49 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 15:00:49.907894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a67b6-fc73-4523-8e88-5b8239fb20e8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:49.986336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:50.017846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 372/744] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 15:00:50.018823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643d5ee-19bd-48a7-b09c-266cc662bfc9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:50.021537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:50.066473 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a67b6-fc73-4523-8e88-5b8239fb20e8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:50.104170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b344-d651-476d-9301-5d1954cf9406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:50.105697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b344-d651-476d-9301-5d1954cf9406 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.106748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b344-d651-476d-9301-5d1954cf9406 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.107225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b344-d651-476d-9301-5d1954cf9406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.118108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b344-d651-476d-9301-5d1954cf9406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:50.120048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b344-d651-476d-9301-5d1954cf9406 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fd57b344-d651-476d-9301-5d1954cf9406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:50.139755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:50.140896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:50.141930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:50.141930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:50.141930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:50.141930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:50.142819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 373/745] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:50.143594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b344-d651-476d-9301-5d1954cf9406 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:50.153762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643d5ee-19bd-48a7-b09c-266cc662bfc9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:50.194584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d04a33-b332-4bab-8621-300d7c492556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:50.195507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d04a33-b332-4bab-8621-300d7c492556 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.195667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d04a33-b332-4bab-8621-300d7c492556 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.195935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d04a33-b332-4bab-8621-300d7c492556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.206423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d04a33-b332-4bab-8621-300d7c492556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:50.207897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d04a33-b332-4bab-8621-300d7c492556 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f2d04a33-b332-4bab-8621-300d7c492556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:50.228505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:50.229529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:50.235912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:50.235912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:50.235912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:50.235912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:50.235912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 373/746] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:50.235912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f1055-a71b-42c1-9a78-671694bdab95 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.235912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f1055-a71b-42c1-9a78-671694bdab95 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.235912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f1055-a71b-42c1-9a78-671694bdab95 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.235912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 374/747] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:50.236549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f1055-a71b-42c1-9a78-671694bdab95 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:50.258176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:50.275848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b344-d651-476d-9301-5d1954cf9406 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:50.315360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8af48f-a361-4b35-a115-671663535123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:50.316031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8af48f-a361-4b35-a115-671663535123 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.316306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8af48f-a361-4b35-a115-671663535123 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.316589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8af48f-a361-4b35-a115-671663535123 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.317000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:50.317309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8af48f-a361-4b35-a115-671663535123 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:50.318936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8af48f-a361-4b35-a115-671663535123 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:50.335265 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 374/748] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:00:50 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:00:50.336719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1faa-5b39-491a-a76e-ed8f3a77a03c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.337007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1faa-5b39-491a-a76e-ed8f3a77a03c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.337283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1faa-5b39-491a-a76e-ed8f3a77a03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.356899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ae4f1faa-5b39-491a-a76e-ed8f3a77a03c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:50.358105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ae4f1faa-5b39-491a-a76e-ed8f3a77a03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:50.390932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f1055-a71b-42c1-9a78-671694bdab95 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:50.433724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204ed02-4b29-42a4-8c5b-a78ea957e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:50.434403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204ed02-4b29-42a4-8c5b-a78ea957e329 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.434694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204ed02-4b29-42a4-8c5b-a78ea957e329 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.434972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204ed02-4b29-42a4-8c5b-a78ea957e329 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.435708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204ed02-4b29-42a4-8c5b-a78ea957e329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:50.436023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204ed02-4b29-42a4-8c5b-a78ea957e329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:50.437456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204ed02-4b29-42a4-8c5b-a78ea957e329 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:50.456763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 375/749] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:50.456763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204ed02-4b29-42a4-8c5b-a78ea957e329 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:50.463794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 375/750] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:00:50.465577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f1faa-5b39-491a-a76e-ed8f3a77a03c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:50.585875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:50.624361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f1faa-5b39-491a-a76e-ed8f3a77a03c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:50.647829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204ed02-4b29-42a4-8c5b-a78ea957e329 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:50.663556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:50.669512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abb67d-4d8c-4fec-a2d1-099c6198c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:50.670678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abb67d-4d8c-4fec-a2d1-099c6198c647 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.671167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abb67d-4d8c-4fec-a2d1-099c6198c647 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.671742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abb67d-4d8c-4fec-a2d1-099c6198c647 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.680725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abb67d-4d8c-4fec-a2d1-099c6198c647 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:50.682661 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abb67d-4d8c-4fec-a2d1-099c6198c647 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:50.698067 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7577a7d-705e-4c9d-ba55-c3b28723a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:50.699600 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7577a7d-705e-4c9d-ba55-c3b28723a140 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.700092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7577a7d-705e-4c9d-ba55-c3b28723a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.700570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7577a7d-705e-4c9d-ba55-c3b28723a140 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.701509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7577a7d-705e-4c9d-ba55-c3b28723a140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:50.702041 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7577a7d-705e-4c9d-ba55-c3b28723a140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-96abb67d-4d8c-4fec-a2d1-099c6198c647 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:50.702847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:50.703764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:50.704712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 376/751] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:00:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:50.706615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7577a7d-705e-4c9d-ba55-c3b28723a140 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:50.710439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abb67d-4d8c-4fec-a2d1-099c6198c647 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:50.724624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 376/752] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:50.725523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7577a7d-705e-4c9d-ba55-c3b28723a140 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:50.876226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7577a7d-705e-4c9d-ba55-c3b28723a140 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:50.876405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abb67d-4d8c-4fec-a2d1-099c6198c647 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:50.928726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938b0d6-c421-4b4c-9712-35a87f750006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:50.929638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938b0d6-c421-4b4c-9712-35a87f750006 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.929915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938b0d6-c421-4b4c-9712-35a87f750006 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.930201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938b0d6-c421-4b4c-9712-35a87f750006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.935553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:50.942481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b4d23-c5d1-4c21-92bd-d9a986354a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:50.943917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b4d23-c5d1-4c21-92bd-d9a986354a31 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:50.944409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b4d23-c5d1-4c21-92bd-d9a986354a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:50.944914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b4d23-c5d1-4c21-92bd-d9a986354a31 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:50.946358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b4d23-c5d1-4c21-92bd-d9a986354a31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:50.946829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938b0d6-c421-4b4c-9712-35a87f750006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:50.947075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b4d23-c5d1-4c21-92bd-d9a986354a31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:50.950276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b4d23-c5d1-4c21-92bd-d9a986354a31 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4938b0d6-c421-4b4c-9712-35a87f750006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:50.959240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:50.960204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:50.961071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:50.965688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 377/753] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:50.967630 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938b0d6-c421-4b4c-9712-35a87f750006 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:50.978386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 377/754] 10.222.0.90 () {56 vars in 1149 bytes} [Tue Jun 21 15:00:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:50.979528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b4d23-c5d1-4c21-92bd-d9a986354a31 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:51.017890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:51.131830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b4d23-c5d1-4c21-92bd-d9a986354a31 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:51.144591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938b0d6-c421-4b4c-9712-35a87f750006 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:51.180055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc944ec4-c9c1-4822-a36f-7c9b521ddf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:51.181108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc944ec4-c9c1-4822-a36f-7c9b521ddf97 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:51.181650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc944ec4-c9c1-4822-a36f-7c9b521ddf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:51.182150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc944ec4-c9c1-4822-a36f-7c9b521ddf97 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:51.183238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc944ec4-c9c1-4822-a36f-7c9b521ddf97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:51.183758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc944ec4-c9c1-4822-a36f-7c9b521ddf97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:51.186016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc944ec4-c9c1-4822-a36f-7c9b521ddf97 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:51.196651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 378/755] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:51.197865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc944ec4-c9c1-4822-a36f-7c9b521ddf97 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:51.213899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dbd96-fafc-4523-924f-587af9c6f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:51.215739 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dbd96-fafc-4523-924f-587af9c6f353 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:51.216178 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dbd96-fafc-4523-924f-587af9c6f353 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:51.216582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dbd96-fafc-4523-924f-587af9c6f353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:51.228912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dbd96-fafc-4523-924f-587af9c6f353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:51.232002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dbd96-fafc-4523-924f-587af9c6f353 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ce8dbd96-fafc-4523-924f-587af9c6f353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:51.258955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:51.259955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:51.260862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:51.260862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:51.260862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:51.260862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:51.260862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:51.260862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:51.260862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:51.260862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:51.262001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 378/756] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:51.263197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dbd96-fafc-4523-924f-587af9c6f353 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:51.341645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:51.359052 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc944ec4-c9c1-4822-a36f-7c9b521ddf97 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:51.361690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:51.408695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b4123-bf24-4a05-89db-02cc80542414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:51.409542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4123-bf24-4a05-89db-02cc80542414 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:51.409834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4123-bf24-4a05-89db-02cc80542414 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:51.410112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4123-bf24-4a05-89db-02cc80542414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:51.421070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dbd96-fafc-4523-924f-587af9c6f353 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:51.459549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67af17c-5d85-4b51-8f48-40d194194e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:51.460885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67af17c-5d85-4b51-8f48-40d194194e7e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:51.461736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67af17c-5d85-4b51-8f48-40d194194e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:51.462319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67af17c-5d85-4b51-8f48-40d194194e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:51.474591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67af17c-5d85-4b51-8f48-40d194194e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:51.476940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67af17c-5d85-4b51-8f48-40d194194e7e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:51.497506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b4123-bf24-4a05-89db-02cc80542414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d67af17c-5d85-4b51-8f48-40d194194e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:51.498164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:51.499061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:51.500046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:51.500046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:51.500046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:51.500046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:51.500273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b4123-bf24-4a05-89db-02cc80542414 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:51.505809 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 379/757] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:51.507044 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67af17c-5d85-4b51-8f48-40d194194e7e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:51.625016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:51.628271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67af17c-5d85-4b51-8f48-40d194194e7e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:51.639081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 379/758] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:00:51.640194 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b4123-bf24-4a05-89db-02cc80542414 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:51.646897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:51.681275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da2f92-312e-4db9-ac1c-8e8ff222ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:51.681900 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da2f92-312e-4db9-ac1c-8e8ff222ee4d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:51.682314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da2f92-312e-4db9-ac1c-8e8ff222ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:51.682619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da2f92-312e-4db9-ac1c-8e8ff222ee4d None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:51.683603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da2f92-312e-4db9-ac1c-8e8ff222ee4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:51.684000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da2f92-312e-4db9-ac1c-8e8ff222ee4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:51.685449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da2f92-312e-4db9-ac1c-8e8ff222ee4d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:51.703143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 380/759] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:51.704001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da2f92-312e-4db9-ac1c-8e8ff222ee4d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:51.769971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b4123-bf24-4a05-89db-02cc80542414 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:51.812598 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83de6a2-fcdc-47f2-9e62-f51c678392ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:51.813439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83de6a2-fcdc-47f2-9e62-f51c678392ce None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:51.813842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83de6a2-fcdc-47f2-9e62-f51c678392ce None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:51.814213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83de6a2-fcdc-47f2-9e62-f51c678392ce None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:51.815284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83de6a2-fcdc-47f2-9e62-f51c678392ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:51.815718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83de6a2-fcdc-47f2-9e62-f51c678392ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:51.817289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83de6a2-fcdc-47f2-9e62-f51c678392ce None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:51.830318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 380/760] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:51.834246 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da2f92-312e-4db9-ac1c-8e8ff222ee4d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:51.835362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83de6a2-fcdc-47f2-9e62-f51c678392ce None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:51.875781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d5dd-ef97-4e5c-876c-cfbcbe542ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:51.876914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d5dd-ef97-4e5c-876c-cfbcbe542ccd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:51.877345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d5dd-ef97-4e5c-876c-cfbcbe542ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:51.877796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d5dd-ef97-4e5c-876c-cfbcbe542ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:51.886077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:51.891057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d5dd-ef97-4e5c-876c-cfbcbe542ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:51.892704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d5dd-ef97-4e5c-876c-cfbcbe542ccd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0b67d5dd-ef97-4e5c-876c-cfbcbe542ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:51.910460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:51.911567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:51.912528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:51.912528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:51.912528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:51.912528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:51.912528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 381/761] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:51.912838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7c755-45f5-4a7a-8c4b-3158d3ea6200 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:51.913127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7c755-45f5-4a7a-8c4b-3158d3ea6200 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:51.913403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7c755-45f5-4a7a-8c4b-3158d3ea6200 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:51.914928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 382/762] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:51.915616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7c755-45f5-4a7a-8c4b-3158d3ea6200 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:51.947278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:51.955172 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83de6a2-fcdc-47f2-9e62-f51c678392ce None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:51.991500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b551e2d-9747-4053-a5b3-3f406fd3c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:51.992232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b551e2d-9747-4053-a5b3-3f406fd3c35a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:51.992549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b551e2d-9747-4053-a5b3-3f406fd3c35a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:51.992853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b551e2d-9747-4053-a5b3-3f406fd3c35a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:51.993816 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b551e2d-9747-4053-a5b3-3f406fd3c35a None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=8ebffb0a0cf04bc0809a94ddd3a347b9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:51.994139 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b551e2d-9747-4053-a5b3-3f406fd3c35a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:51.995736 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b551e2d-9747-4053-a5b3-3f406fd3c35a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:52.009895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 381/763] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:51 2022] GET /identity/v3/role_assignments?user.id=8ebffb0a0cf04bc0809a94ddd3a347b9&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:52.012075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b551e2d-9747-4053-a5b3-3f406fd3c35a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:52.051744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7c755-45f5-4a7a-8c4b-3158d3ea6200 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:52.104041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c514b-2bdb-4914-b9f3-f0beeb6fdb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:52.105335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c514b-2bdb-4914-b9f3-f0beeb6fdb09 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.105878 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c514b-2bdb-4914-b9f3-f0beeb6fdb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.106429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c514b-2bdb-4914-b9f3-f0beeb6fdb09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.115769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c514b-2bdb-4914-b9f3-f0beeb6fdb09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:52.117754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c514b-2bdb-4914-b9f3-f0beeb6fdb09 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a54c514b-2bdb-4914-b9f3-f0beeb6fdb09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:52.133856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:52.134946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:52.136972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:52.139780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 383/764] 10.222.0.90 () {56 vars in 1093 bytes} [Tue Jun 21 15:00:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:52.141432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba8827-6c9c-4c9c-a56a-a338d16aa70a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.141977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba8827-6c9c-4c9c-a56a-a338d16aa70a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.142460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba8827-6c9c-4c9c-a56a-a338d16aa70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.149722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b551e2d-9747-4053-a5b3-3f406fd3c35a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:52.161879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-23ba8827-6c9c-4c9c-a56a-a338d16aa70a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:52.163448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-23ba8827-6c9c-4c9c-a56a-a338d16aa70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:52.165908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:52.191153 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2914-446b-4d6d-970c-38dec932a677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:52.192205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2914-446b-4d6d-970c-38dec932a677 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.192606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2914-446b-4d6d-970c-38dec932a677 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.192957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c2914-446b-4d6d-970c-38dec932a677 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.193821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c2914-446b-4d6d-970c-38dec932a677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:52.194349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c2914-446b-4d6d-970c-38dec932a677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:52.196506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c2914-446b-4d6d-970c-38dec932a677 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:52.220635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 382/765] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:52.221994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2914-446b-4d6d-970c-38dec932a677 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:52.253496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 384/766] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:00:52.253496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba8827-6c9c-4c9c-a56a-a338d16aa70a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:52.265945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:52.356298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c2914-446b-4d6d-970c-38dec932a677 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:52.376444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba8827-6c9c-4c9c-a56a-a338d16aa70a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:52.395958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3918582-fe64-4bb0-93cc-b7e3ffd1e64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:52.396653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3918582-fe64-4bb0-93cc-b7e3ffd1e64d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.396958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3918582-fe64-4bb0-93cc-b7e3ffd1e64d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.397510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3918582-fe64-4bb0-93cc-b7e3ffd1e64d None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.398219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3918582-fe64-4bb0-93cc-b7e3ffd1e64d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:52.398530 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3918582-fe64-4bb0-93cc-b7e3ffd1e64d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:52.399987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3918582-fe64-4bb0-93cc-b7e3ffd1e64d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:52.416990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c277c8-0dfa-4c98-ac33-8f6a6c03ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:52.419086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c277c8-0dfa-4c98-ac33-8f6a6c03ae72 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.419595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c277c8-0dfa-4c98-ac33-8f6a6c03ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.420074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c277c8-0dfa-4c98-ac33-8f6a6c03ae72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.421910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 383/767] 10.222.0.90 () {56 vars in 1133 bytes} [Tue Jun 21 15:00:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:52.423040 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3918582-fe64-4bb0-93cc-b7e3ffd1e64d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:52.428754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c277c8-0dfa-4c98-ac33-8f6a6c03ae72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:52.430586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c277c8-0dfa-4c98-ac33-8f6a6c03ae72 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a8c277c8-0dfa-4c98-ac33-8f6a6c03ae72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:52.446816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:52.447742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:52.448758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:52.448758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:52.448758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:52.448758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:52.448758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:52.448758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:52.448758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:52.448758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:52.456365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:52.456644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 385/768] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:52.458171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c277c8-0dfa-4c98-ac33-8f6a6c03ae72 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:52.536979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:52.538737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3918582-fe64-4bb0-93cc-b7e3ffd1e64d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:52.575024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c277c8-0dfa-4c98-ac33-8f6a6c03ae72 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:52.580679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c1ff-44d2-43a1-b4a3-de288fc43319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:52.581611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c1ff-44d2-43a1-b4a3-de288fc43319 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.581975 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c1ff-44d2-43a1-b4a3-de288fc43319 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.582351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c1ff-44d2-43a1-b4a3-de288fc43319 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.583088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728c1ff-44d2-43a1-b4a3-de288fc43319 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:52.584643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728c1ff-44d2-43a1-b4a3-de288fc43319 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a728c1ff-44d2-43a1-b4a3-de288fc43319 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:52.598468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:52.599499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 15:00:52.600342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:52.605453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 384/769] 10.222.0.90 () {56 vars in 1129 bytes} [Tue Jun 21 15:00:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:52.606562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c1ff-44d2-43a1-b4a3-de288fc43319 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:52.618072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9af55d-4211-4a2d-8d3f-f3d7acbee4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:52.619232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af55d-4211-4a2d-8d3f-f3d7acbee4db None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.619726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af55d-4211-4a2d-8d3f-f3d7acbee4db None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.620893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af55d-4211-4a2d-8d3f-f3d7acbee4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.635885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9af55d-4211-4a2d-8d3f-f3d7acbee4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:52.638331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9af55d-4211-4a2d-8d3f-f3d7acbee4db None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8f9af55d-4211-4a2d-8d3f-f3d7acbee4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:52.658204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:52.659594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:52.660575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:52.660575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:52.660575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:52.660575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:52.663143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 386/770] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:52.664236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9af55d-4211-4a2d-8d3f-f3d7acbee4db None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:52.728382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:52.738432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c1ff-44d2-43a1-b4a3-de288fc43319 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:52.783083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde0d60-83e2-4531-98f2-58581b794df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:52.784118 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde0d60-83e2-4531-98f2-58581b794df2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.784412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde0d60-83e2-4531-98f2-58581b794df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.784860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde0d60-83e2-4531-98f2-58581b794df2 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.786507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde0d60-83e2-4531-98f2-58581b794df2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:52.787024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde0d60-83e2-4531-98f2-58581b794df2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:52.788868 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde0d60-83e2-4531-98f2-58581b794df2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:52.801026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9af55d-4211-4a2d-8d3f-f3d7acbee4db None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:52.809518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 385/771] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:52.809518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde0d60-83e2-4531-98f2-58581b794df2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:52.840546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:52.858930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b2ec9-a012-4767-a32c-15a522b5edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:52.859741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b2ec9-a012-4767-a32c-15a522b5edde None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.859922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b2ec9-a012-4767-a32c-15a522b5edde None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.859922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b2ec9-a012-4767-a32c-15a522b5edde None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.861055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b2ec9-a012-4767-a32c-15a522b5edde None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:52.861578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b2ec9-a012-4767-a32c-15a522b5edde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:52.864509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b2ec9-a012-4767-a32c-15a522b5edde None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:52.877835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 387/772] 10.222.0.90 () {56 vars in 1124 bytes} [Tue Jun 21 15:00:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:52.877835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17114b-2b69-4ef1-bd2a-ab3a40a16696 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:52.877835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17114b-2b69-4ef1-bd2a-ab3a40a16696 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:52.877835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17114b-2b69-4ef1-bd2a-ab3a40a16696 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:52.877835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 388/773] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:52.880432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17114b-2b69-4ef1-bd2a-ab3a40a16696 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:52.961171 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde0d60-83e2-4531-98f2-58581b794df2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:53.004115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5346d1-c8c3-4131-a5e1-082047912d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:53.005694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5346d1-c8c3-4131-a5e1-082047912d84 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:53.006218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5346d1-c8c3-4131-a5e1-082047912d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:53.006557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5346d1-c8c3-4131-a5e1-082047912d84 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:53.007694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5346d1-c8c3-4131-a5e1-082047912d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:53.008259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5346d1-c8c3-4131-a5e1-082047912d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:53.010881 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5346d1-c8c3-4131-a5e1-082047912d84 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:53.025814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17114b-2b69-4ef1-bd2a-ab3a40a16696 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:53.029747 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 386/774] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:53.031048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083beaa-e674-4aa6-9f75-65d90dd9235d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:53.031344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083beaa-e674-4aa6-9f75-65d90dd9235d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:53.031653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083beaa-e674-4aa6-9f75-65d90dd9235d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:53.050843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3083beaa-e674-4aa6-9f75-65d90dd9235d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:53.052308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3083beaa-e674-4aa6-9f75-65d90dd9235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:53.067862 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:53.070395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c289f1e-c666-4014-8a12-614745482152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:53.070945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c289f1e-c666-4014-8a12-614745482152 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:53.071231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c289f1e-c666-4014-8a12-614745482152 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:53.072169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c289f1e-c666-4014-8a12-614745482152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:53.073968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c289f1e-c666-4014-8a12-614745482152 None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=f0564976d31a4fe79742b978c6bee315) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:53.075038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c289f1e-c666-4014-8a12-614745482152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:53.077108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c289f1e-c666-4014-8a12-614745482152 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:53.085442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 389/775] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:00:52 2022] GET /identity/v3/role_assignments?user.id=f0564976d31a4fe79742b978c6bee315&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:53.086981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c289f1e-c666-4014-8a12-614745482152 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:53.170519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 387/776] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:00:53.173158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083beaa-e674-4aa6-9f75-65d90dd9235d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:53.194345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:53.266623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c289f1e-c666-4014-8a12-614745482152 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:53.317284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc372-6a25-463e-8e9e-daaeb0c11867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:53.318024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc372-6a25-463e-8e9e-daaeb0c11867 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:53.318308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc372-6a25-463e-8e9e-daaeb0c11867 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:53.318588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc372-6a25-463e-8e9e-daaeb0c11867 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:53.319309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dc372-6a25-463e-8e9e-daaeb0c11867 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:53.319621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dc372-6a25-463e-8e9e-daaeb0c11867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:53.320994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dc372-6a25-463e-8e9e-daaeb0c11867 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:53.327753 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 390/777] 10.222.0.90 () {56 vars in 1124 bytes} [Tue Jun 21 15:00:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:53.328598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc372-6a25-463e-8e9e-daaeb0c11867 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:53.345346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083beaa-e674-4aa6-9f75-65d90dd9235d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:53.407950 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5330c59-f45f-4fc7-bf26-50ef4a15a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:53.408796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5330c59-f45f-4fc7-bf26-50ef4a15a162 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:53.409084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5330c59-f45f-4fc7-bf26-50ef4a15a162 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:53.409365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5330c59-f45f-4fc7-bf26-50ef4a15a162 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:53.419750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5330c59-f45f-4fc7-bf26-50ef4a15a162 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:53.421204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5330c59-f45f-4fc7-bf26-50ef4a15a162 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f5330c59-f45f-4fc7-bf26-50ef4a15a162 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:53.445513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:53.446544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:53.447466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:53.447466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:53.447466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:53.447466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:53.447466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:53.447466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:53.447466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:53.447466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:53.453356 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 388/778] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:53.454821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5330c59-f45f-4fc7-bf26-50ef4a15a162 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:53.467572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc372-6a25-463e-8e9e-daaeb0c11867 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:53.470688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:53.485471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:53.511949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c81694-f8d5-471f-963a-0ec54b4c1ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:53.512775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c81694-f8d5-471f-963a-0ec54b4c1ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:53.513348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c81694-f8d5-471f-963a-0ec54b4c1ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:53.513725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c81694-f8d5-471f-963a-0ec54b4c1ca1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:53.514458 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c81694-f8d5-471f-963a-0ec54b4c1ca1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:53.516076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c81694-f8d5-471f-963a-0ec54b4c1ca1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-30c81694-f8d5-471f-963a-0ec54b4c1ca1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:53.530697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:53.532452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:00:53.534904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:53.537632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 391/779] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:53 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:53.538922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c81694-f8d5-471f-963a-0ec54b4c1ca1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:53.653248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5330c59-f45f-4fc7-bf26-50ef4a15a162 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:53.675867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c81694-f8d5-471f-963a-0ec54b4c1ca1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:53.695976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efafcfe-da47-48ef-a4f6-7a765bf92cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:53.696640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efafcfe-da47-48ef-a4f6-7a765bf92cdf None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:53.696927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efafcfe-da47-48ef-a4f6-7a765bf92cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:53.697197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efafcfe-da47-48ef-a4f6-7a765bf92cdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:53.698033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efafcfe-da47-48ef-a4f6-7a765bf92cdf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:53.700316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efafcfe-da47-48ef-a4f6-7a765bf92cdf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:53.723268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c137e7-af4f-4401-b5ca-63e1b189eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:53.724238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c137e7-af4f-4401-b5ca-63e1b189eb96 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:53.724698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c137e7-af4f-4401-b5ca-63e1b189eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:53.725124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c137e7-af4f-4401-b5ca-63e1b189eb96 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:53.726156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c137e7-af4f-4401-b5ca-63e1b189eb96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:53.726867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c137e7-af4f-4401-b5ca-63e1b189eb96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:53.733784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 389/780] 10.222.0.90 () {60 vars in 1144 bytes} [Tue Jun 21 15:00:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:00:53.734052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c137e7-af4f-4401-b5ca-63e1b189eb96 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:53.734154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efafcfe-da47-48ef-a4f6-7a765bf92cdf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:53.764169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 392/781] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:53.771194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c137e7-af4f-4401-b5ca-63e1b189eb96 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:53.862030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:53.904143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:53.920055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efafcfe-da47-48ef-a4f6-7a765bf92cdf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:53.986829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3f370-2585-454f-a3b5-8fbd6589314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:53.987767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3f370-2585-454f-a3b5-8fbd6589314c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:53.988921 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3f370-2585-454f-a3b5-8fbd6589314c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:53.989455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3f370-2585-454f-a3b5-8fbd6589314c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:53.991010 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3f370-2585-454f-a3b5-8fbd6589314c None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:53.991520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3f370-2585-454f-a3b5-8fbd6589314c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:53.993726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3f370-2585-454f-a3b5-8fbd6589314c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:54.005805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 390/782] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:00:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:54.007062 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3f370-2585-454f-a3b5-8fbd6589314c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:54.030876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c137e7-af4f-4401-b5ca-63e1b189eb96 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:54.071213 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656f65b-c3ba-405f-bc67-8fb66e817ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:54.072466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f65b-c3ba-405f-bc67-8fb66e817ca6 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:54.072890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f65b-c3ba-405f-bc67-8fb66e817ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:54.074573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f65b-c3ba-405f-bc67-8fb66e817ca6 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/2bd3ffc0a30648139b2cbf19bb6bd535/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:54.078144 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656f65b-c3ba-405f-bc67-8fb66e817ca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=2bd3ffc0a30648139b2cbf19bb6bd535, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:54.080194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656f65b-c3ba-405f-bc67-8fb66e817ca6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:54.100271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 393/783] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:00:53 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/2bd3ffc0a30648139b2cbf19bb6bd535/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:00:54.146495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3f370-2585-454f-a3b5-8fbd6589314c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:54.180546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:54.199449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f76269-790a-4299-879a-41aea9f068da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:54.200224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f76269-790a-4299-879a-41aea9f068da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:54.200510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f76269-790a-4299-879a-41aea9f068da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:54.200780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f76269-790a-4299-879a-41aea9f068da None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:54.201585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f76269-790a-4299-879a-41aea9f068da None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:54.201898 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f76269-790a-4299-879a-41aea9f068da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:54.203516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f76269-790a-4299-879a-41aea9f068da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:54.214006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 391/784] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:00:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:54.222085 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656f65b-c3ba-405f-bc67-8fb66e817ca6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:54.380891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f950-7835-45ad-b8b4-4cea09f3e79c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:54.381243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f950-7835-45ad-b8b4-4cea09f3e79c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:54.381435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f950-7835-45ad-b8b4-4cea09f3e79c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:54.383147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 392/785] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:54.390854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151a94d-2061-4941-86ed-f1962476ecab None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:54.391119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151a94d-2061-4941-86ed-f1962476ecab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:54.391758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151a94d-2061-4941-86ed-f1962476ecab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:54.408403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:54.415601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656f65b-c3ba-405f-bc67-8fb66e817ca6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:54.438655 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4151a94d-2061-4941-86ed-f1962476ecab None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:54.439980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4151a94d-2061-4941-86ed-f1962476ecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:54.466706 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca1237-4796-4341-a1d3-2bcf26a4950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:54.467783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca1237-4796-4341-a1d3-2bcf26a4950f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:54.468275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca1237-4796-4341-a1d3-2bcf26a4950f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:54.468755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca1237-4796-4341-a1d3-2bcf26a4950f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:54.469921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca1237-4796-4341-a1d3-2bcf26a4950f None admin] RBAC: Adding query filter params (interface=public, service_id=2ce0845b7c7a45e8bfb655aeb2939b15, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:54.470506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca1237-4796-4341-a1d3-2bcf26a4950f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:54.472491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca1237-4796-4341-a1d3-2bcf26a4950f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:54.483471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 394/786] 10.222.0.90 () {56 vars in 1251 bytes} [Tue Jun 21 15:00:54 2022] GET /identity/v3/endpoints?service_id=2ce0845b7c7a45e8bfb655aeb2939b15&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:00:54.499940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca1237-4796-4341-a1d3-2bcf26a4950f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:54.568439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 393/787] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:00:54.634957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151a94d-2061-4941-86ed-f1962476ecab None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:54.685080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca1237-4796-4341-a1d3-2bcf26a4950f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:54.739461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621679f-7164-47d4-83ba-25ca4a6817f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:54.740147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621679f-7164-47d4-83ba-25ca4a6817f2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:54.740425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621679f-7164-47d4-83ba-25ca4a6817f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:54.740697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621679f-7164-47d4-83ba-25ca4a6817f2 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:54.741383 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621679f-7164-47d4-83ba-25ca4a6817f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:54.742810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621679f-7164-47d4-83ba-25ca4a6817f2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:54.750178 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 395/788] 10.222.0.90 () {56 vars in 1087 bytes} [Tue Jun 21 15:00:54 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:54.861792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151a94d-2061-4941-86ed-f1962476ecab None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:54.907080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:54.946457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273e30-364e-4243-8c42-6fe0a4ec515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:54.947213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273e30-364e-4243-8c42-6fe0a4ec515d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:54.947506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273e30-364e-4243-8c42-6fe0a4ec515d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:54.947797 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51273e30-364e-4243-8c42-6fe0a4ec515d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:54.975197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51273e30-364e-4243-8c42-6fe0a4ec515d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-51273e30-364e-4243-8c42-6fe0a4ec515d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:54.987465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:54.988798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:54.989706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 394/789] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:55.001589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621679f-7164-47d4-83ba-25ca4a6817f2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:55.043983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:55.149088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621679f-7164-47d4-83ba-25ca4a6817f2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:55.192825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2d31d-f57b-423b-b411-39cf59ec11d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:55.193904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2d31d-f57b-423b-b411-39cf59ec11d1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:55.194391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2d31d-f57b-423b-b411-39cf59ec11d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:55.194890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2d31d-f57b-423b-b411-39cf59ec11d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:55.195836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2d31d-f57b-423b-b411-39cf59ec11d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:55.196345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2d31d-f57b-423b-b411-39cf59ec11d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:55.198540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2d31d-f57b-423b-b411-39cf59ec11d1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:55.210231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 396/790] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:55.218246 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273e30-364e-4243-8c42-6fe0a4ec515d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:55.349546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51273e30-364e-4243-8c42-6fe0a4ec515d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:55.396782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f1bf-b452-46b9-b2bc-3c43c23e7387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:55.398169 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f1bf-b452-46b9-b2bc-3c43c23e7387 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:55.398913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f1bf-b452-46b9-b2bc-3c43c23e7387 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:55.399668 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f1bf-b452-46b9-b2bc-3c43c23e7387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:55.426177 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2f1bf-b452-46b9-b2bc-3c43c23e7387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:55.428001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2f1bf-b452-46b9-b2bc-3c43c23e7387 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b5b2f1bf-b452-46b9-b2bc-3c43c23e7387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:55.455129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:55.456181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:55.457118 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:55.457118 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:55.457118 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:55.457118 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:55.459139 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 395/791] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:55.465734 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2d31d-f57b-423b-b411-39cf59ec11d1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:55.609610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:55.631587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2d31d-f57b-423b-b411-39cf59ec11d1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:55.681534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0829e-b569-488e-82b8-fcce89e6f5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:55.682562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0829e-b569-488e-82b8-fcce89e6f5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:55.683672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0829e-b569-488e-82b8-fcce89e6f5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:55.684150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0829e-b569-488e-82b8-fcce89e6f5c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:55.685072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0829e-b569-488e-82b8-fcce89e6f5c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:55.685633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0829e-b569-488e-82b8-fcce89e6f5c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:55.687644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0829e-b569-488e-82b8-fcce89e6f5c1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:55.710185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 397/792] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:55.715830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f1bf-b452-46b9-b2bc-3c43c23e7387 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:55.754573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:55.762369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eca73f-e608-40f2-9c2d-beaf1d5f3cc6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:55.762988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eca73f-e608-40f2-9c2d-beaf1d5f3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:55.763393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eca73f-e608-40f2-9c2d-beaf1d5f3cc6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:55.765267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 398/793] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:00:55.770744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7890e-c8fc-45a3-8f31-4e0a167e4ae4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:55.771037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7890e-c8fc-45a3-8f31-4e0a167e4ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:55.771326 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7890e-c8fc-45a3-8f31-4e0a167e4ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:55.814488 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f1a7890e-c8fc-45a3-8f31-4e0a167e4ae4 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:55.815943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f1a7890e-c8fc-45a3-8f31-4e0a167e4ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:55.849259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f1bf-b452-46b9-b2bc-3c43c23e7387 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:55.886349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed395b71-6f91-48dc-814f-289ef6152785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:55.887164 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed395b71-6f91-48dc-814f-289ef6152785 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:55.887449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed395b71-6f91-48dc-814f-289ef6152785 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:55.887728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed395b71-6f91-48dc-814f-289ef6152785 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:55.896074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed395b71-6f91-48dc-814f-289ef6152785 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:55.897534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed395b71-6f91-48dc-814f-289ef6152785 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ed395b71-6f91-48dc-814f-289ef6152785 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:55.912990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:55.914623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:55.915679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 396/794] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:55.933495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed395b71-6f91-48dc-814f-289ef6152785 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:56.016028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 399/795] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:00:56.027430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:56.040994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed395b71-6f91-48dc-814f-289ef6152785 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:56.052692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7890e-c8fc-45a3-8f31-4e0a167e4ae4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:56.078150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bb615-13dc-4061-9db8-a89d0042bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:56.081873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bb615-13dc-4061-9db8-a89d0042bf05 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:56.083628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bb615-13dc-4061-9db8-a89d0042bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:56.084070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bb615-13dc-4061-9db8-a89d0042bf05 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:56.085881 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bb615-13dc-4061-9db8-a89d0042bf05 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:56.086539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bb615-13dc-4061-9db8-a89d0042bf05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:56.090350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bb615-13dc-4061-9db8-a89d0042bf05 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:56.123821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 397/796] 10.222.0.90 () {56 vars in 1135 bytes} [Tue Jun 21 15:00:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:56.129149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bb615-13dc-4061-9db8-a89d0042bf05 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:56.223953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:56.265439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7890e-c8fc-45a3-8f31-4e0a167e4ae4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:56.332086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bb615-13dc-4061-9db8-a89d0042bf05 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:56.334081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43a4ad-ecf6-4250-bb96-a83b192afbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:56.334919 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43a4ad-ecf6-4250-bb96-a83b192afbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:56.335240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43a4ad-ecf6-4250-bb96-a83b192afbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:56.335541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43a4ad-ecf6-4250-bb96-a83b192afbe6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:56.356876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43a4ad-ecf6-4250-bb96-a83b192afbe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ee43a4ad-ecf6-4250-bb96-a83b192afbe6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:56.367639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:56.368649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:56.370627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 400/797] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:00:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:56.375724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43a4ad-ecf6-4250-bb96-a83b192afbe6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:56.418194 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998247a-ec61-45fa-8d61-ca236423809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:56.419014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998247a-ec61-45fa-8d61-ca236423809e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:56.419302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998247a-ec61-45fa-8d61-ca236423809e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:56.419640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998247a-ec61-45fa-8d61-ca236423809e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:56.441659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998247a-ec61-45fa-8d61-ca236423809e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:56.443144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998247a-ec61-45fa-8d61-ca236423809e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:56.464644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4998247a-ec61-45fa-8d61-ca236423809e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:56.480614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:56.482076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:56.483270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:56.483270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:56.483270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:56.483270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:56.493421 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 398/798] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:56.494527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998247a-ec61-45fa-8d61-ca236423809e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:56.570214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43a4ad-ecf6-4250-bb96-a83b192afbe6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:56.615718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef936-ced8-4b24-9c67-1a63ea94ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:56.616319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef936-ced8-4b24-9c67-1a63ea94ece9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:56.616608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef936-ced8-4b24-9c67-1a63ea94ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:56.616891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef936-ced8-4b24-9c67-1a63ea94ece9 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:56.617706 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef936-ced8-4b24-9c67-1a63ea94ece9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:56.617980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef936-ced8-4b24-9c67-1a63ea94ece9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:56.619375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aef936-ced8-4b24-9c67-1a63ea94ece9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:56.632191 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998247a-ec61-45fa-8d61-ca236423809e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:56.634404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:56.639531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 401/799] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:00:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:56.646503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef936-ced8-4b24-9c67-1a63ea94ece9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:56.694185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20187b2a-e6f6-4294-bf9c-273400d7dde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:56.694864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20187b2a-e6f6-4294-bf9c-273400d7dde5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:56.695147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20187b2a-e6f6-4294-bf9c-273400d7dde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:56.695428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20187b2a-e6f6-4294-bf9c-273400d7dde5 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:56.696157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20187b2a-e6f6-4294-bf9c-273400d7dde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:56.696465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20187b2a-e6f6-4294-bf9c-273400d7dde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:56.697874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20187b2a-e6f6-4294-bf9c-273400d7dde5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:56.710783 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 399/800] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:56.716685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20187b2a-e6f6-4294-bf9c-273400d7dde5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:56.814692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef936-ced8-4b24-9c67-1a63ea94ece9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:56.844269 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:56.863939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd70e-0ee5-4c0e-a168-34cac907a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:56.864744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd70e-0ee5-4c0e-a168-34cac907a52b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:56.865025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd70e-0ee5-4c0e-a168-34cac907a52b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:56.865299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd70e-0ee5-4c0e-a168-34cac907a52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:56.893201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd70e-0ee5-4c0e-a168-34cac907a52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:56.894785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd70e-0ee5-4c0e-a168-34cac907a52b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8abcd70e-0ee5-4c0e-a168-34cac907a52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:56.929671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:56.930729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:56.931719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:56.931719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:56.931719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:56.931719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:56.931972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20187b2a-e6f6-4294-bf9c-273400d7dde5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:56.932376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 402/801] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:56.932376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129f3ee-7ab7-4460-9983-255ececc1905 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:56.932532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129f3ee-7ab7-4460-9983-255ececc1905 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:56.934955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129f3ee-7ab7-4460-9983-255ececc1905 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:56.939514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 403/802] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:56.940344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129f3ee-7ab7-4460-9983-255ececc1905 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:56.973868 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a55cb-4482-451c-b570-125a1a84e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:56.974655 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a55cb-4482-451c-b570-125a1a84e66b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:56.974938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a55cb-4482-451c-b570-125a1a84e66b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:56.975214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a55cb-4482-451c-b570-125a1a84e66b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:56.983019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a55cb-4482-451c-b570-125a1a84e66b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:56.984566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a55cb-4482-451c-b570-125a1a84e66b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7d6a55cb-4482-451c-b570-125a1a84e66b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:57.000404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:57.001621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:57.002703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:57.002703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:57.002703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:57.002703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:57.002703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:57.002703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:57.002703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:57.002703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:57.006114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 400/803] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:00:57.007474 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:57.007618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0e18-94fe-4304-a59c-0e8cb9d84e5f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.007770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0e18-94fe-4304-a59c-0e8cb9d84e5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.008050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf0e18-94fe-4304-a59c-0e8cb9d84e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.027155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-11cf0e18-94fe-4304-a59c-0e8cb9d84e5f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:57.027952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11cf0e18-94fe-4304-a59c-0e8cb9d84e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:57.068928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129f3ee-7ab7-4460-9983-255ececc1905 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:57.105116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 401/804] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:00:57.106720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f390-1260-4a47-9126-a08524f34b40 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.107009 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f390-1260-4a47-9126-a08524f34b40 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.107284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7f390-1260-4a47-9126-a08524f34b40 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.108708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 402/805] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:57.109318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7f390-1260-4a47-9126-a08524f34b40 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:57.122904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557552b6-c21e-465d-876e-ebe997f578b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:57.125504 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557552b6-c21e-465d-876e-ebe997f578b3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.126034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557552b6-c21e-465d-876e-ebe997f578b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.126533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557552b6-c21e-465d-876e-ebe997f578b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.127465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557552b6-c21e-465d-876e-ebe997f578b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:57.128131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557552b6-c21e-465d-876e-ebe997f578b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:57.129969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557552b6-c21e-465d-876e-ebe997f578b3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:57.143666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 404/806] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:57.145431 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6069f-ac42-4662-8e84-f7f52c846367 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.145943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6069f-ac42-4662-8e84-f7f52c846367 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.146409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6069f-ac42-4662-8e84-f7f52c846367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.164024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cda6069f-ac42-4662-8e84-f7f52c846367 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:57.165217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cda6069f-ac42-4662-8e84-f7f52c846367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:57.182562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:57.239248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7f390-1260-4a47-9126-a08524f34b40 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:57.243129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 405/807] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:00:57.244228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6069f-ac42-4662-8e84-f7f52c846367 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:57.280397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8072212-272f-4fd7-ae3d-e0308b4b7114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:57.281826 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072212-272f-4fd7-ae3d-e0308b4b7114 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.282268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072212-272f-4fd7-ae3d-e0308b4b7114 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.282708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8072212-272f-4fd7-ae3d-e0308b4b7114 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.283678 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8072212-272f-4fd7-ae3d-e0308b4b7114 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:57.283995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8072212-272f-4fd7-ae3d-e0308b4b7114 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:57.285460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8072212-272f-4fd7-ae3d-e0308b4b7114 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:57.298979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:57.304124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 403/808] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:57.304124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8072212-272f-4fd7-ae3d-e0308b4b7114 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:57.374242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6069f-ac42-4662-8e84-f7f52c846367 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:57.414744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c2437-c806-4e98-9802-03dcf2e21fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:57.415536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2437-c806-4e98-9802-03dcf2e21fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.415826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2437-c806-4e98-9802-03dcf2e21fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.416121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c2437-c806-4e98-9802-03dcf2e21fa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.424702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8072212-272f-4fd7-ae3d-e0308b4b7114 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:57.429320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c2437-c806-4e98-9802-03dcf2e21fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:00:57.434935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-762c2437-c806-4e98-9802-03dcf2e21fa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:00:57.438019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:57.439179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 406/809] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:00:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:57.440054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c2437-c806-4e98-9802-03dcf2e21fa1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:57.471537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf3d92-f51b-4e43-99bc-c19e94e721d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:57.472369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf3d92-f51b-4e43-99bc-c19e94e721d9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.472647 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf3d92-f51b-4e43-99bc-c19e94e721d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.472931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf3d92-f51b-4e43-99bc-c19e94e721d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.480974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf3d92-f51b-4e43-99bc-c19e94e721d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:57.482570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf3d92-f51b-4e43-99bc-c19e94e721d9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9edf3d92-f51b-4e43-99bc-c19e94e721d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:57.499900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:57.500941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:00:57.501940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:57.504341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 404/810] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:00:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:57.505363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf3d92-f51b-4e43-99bc-c19e94e721d9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:57.565575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c2437-c806-4e98-9802-03dcf2e21fa1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:57.567112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:57.602174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf677f6-0812-4869-98df-f649d983d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:57.602976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf677f6-0812-4869-98df-f649d983d322 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.603258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf677f6-0812-4869-98df-f649d983d322 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.603538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf677f6-0812-4869-98df-f649d983d322 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.604195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf677f6-0812-4869-98df-f649d983d322 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:57.605740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf677f6-0812-4869-98df-f649d983d322 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:57.617794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf3d92-f51b-4e43-99bc-c19e94e721d9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-abf677f6-0812-4869-98df-f649d983d322 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:57.618022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:57.619230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:57.621136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 407/811] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:00:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:57.622471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf677f6-0812-4869-98df-f649d983d322 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:57.659337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84c2c5-58ab-4635-8b79-dc7884eb7c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:57.660230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84c2c5-58ab-4635-8b79-dc7884eb7c59 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.660508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84c2c5-58ab-4635-8b79-dc7884eb7c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.660779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84c2c5-58ab-4635-8b79-dc7884eb7c59 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/8ebffb0a0cf04bc0809a94ddd3a347b9/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.662813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84c2c5-58ab-4635-8b79-dc7884eb7c59 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=8ebffb0a0cf04bc0809a94ddd3a347b9, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:57.664242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84c2c5-58ab-4635-8b79-dc7884eb7c59 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:57.678481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 405/812] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:00:57 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/8ebffb0a0cf04bc0809a94ddd3a347b9/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:57.679298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84c2c5-58ab-4635-8b79-dc7884eb7c59 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:57.717597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:57.749189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf677f6-0812-4869-98df-f649d983d322 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:57.793371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caf1d6-407b-449e-99b3-79e7093f867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:57.794206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caf1d6-407b-449e-99b3-79e7093f867f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.794506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caf1d6-407b-449e-99b3-79e7093f867f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.794831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caf1d6-407b-449e-99b3-79e7093f867f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.795502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caf1d6-407b-449e-99b3-79e7093f867f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:57.795824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caf1d6-407b-449e-99b3-79e7093f867f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:57.797243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caf1d6-407b-449e-99b3-79e7093f867f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:57.805536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84c2c5-58ab-4635-8b79-dc7884eb7c59 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:57.806296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 408/813] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:00:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:57.808156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273e772-47c6-4410-96ae-635bb1dc60d7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.809698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273e772-47c6-4410-96ae-635bb1dc60d7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.809698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273e772-47c6-4410-96ae-635bb1dc60d7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.810574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 409/814] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:00:57.811217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273e772-47c6-4410-96ae-635bb1dc60d7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:57.847469 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:57.859255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcafacd-0fd3-4c31-b8fd-ff32de4814a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:57.860743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcafacd-0fd3-4c31-b8fd-ff32de4814a9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.860743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcafacd-0fd3-4c31-b8fd-ff32de4814a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.860743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcafacd-0fd3-4c31-b8fd-ff32de4814a9 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.861313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcafacd-0fd3-4c31-b8fd-ff32de4814a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:57.862417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcafacd-0fd3-4c31-b8fd-ff32de4814a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:57.863850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcafacd-0fd3-4c31-b8fd-ff32de4814a9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:57.885181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 406/815] 10.222.0.90 () {56 vars in 1149 bytes} [Tue Jun 21 15:00:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:57.886415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcafacd-0fd3-4c31-b8fd-ff32de4814a9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:57.944653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273e772-47c6-4410-96ae-635bb1dc60d7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:57.985343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b9eab-7ba2-41f8-9f06-b5bdadbfca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:57.986209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b9eab-7ba2-41f8-9f06-b5bdadbfca64 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.986590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b9eab-7ba2-41f8-9f06-b5bdadbfca64 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.986975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b9eab-7ba2-41f8-9f06-b5bdadbfca64 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:57.987780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b9eab-7ba2-41f8-9f06-b5bdadbfca64 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:57.988189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b9eab-7ba2-41f8-9f06-b5bdadbfca64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:57.989709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b9eab-7ba2-41f8-9f06-b5bdadbfca64 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:57.995964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 410/816] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:00:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:57.998623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d166ce9-d45a-484d-b421-ac23e63c1c27 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:57.998977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d166ce9-d45a-484d-b421-ac23e63c1c27 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:57.999262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d166ce9-d45a-484d-b421-ac23e63c1c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:58.005613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:58.032197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7d166ce9-d45a-484d-b421-ac23e63c1c27 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:00:58.033401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7d166ce9-d45a-484d-b421-ac23e63c1c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:00:58.034141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcafacd-0fd3-4c31-b8fd-ff32de4814a9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:58.098392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df7469-33e8-4695-9161-6369c9b8126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:58.099640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df7469-33e8-4695-9161-6369c9b8126a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:58.099933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df7469-33e8-4695-9161-6369c9b8126a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:58.100215 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df7469-33e8-4695-9161-6369c9b8126a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:58.113298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df7469-33e8-4695-9161-6369c9b8126a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:58.114988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df7469-33e8-4695-9161-6369c9b8126a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:58.135196 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 411/817] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:00:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:00:58.135196 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d166ce9-d45a-484d-b421-ac23e63c1c27 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-49df7469-33e8-4695-9161-6369c9b8126a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:58.135867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:58.136829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:58.137879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:58.137879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:58.137879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:58.137879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:58.137879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 407/818] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:58.138666 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df7469-33e8-4695-9161-6369c9b8126a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:58.163114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:58.282384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d166ce9-d45a-484d-b421-ac23e63c1c27 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:58.298016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df7469-33e8-4695-9161-6369c9b8126a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:58.329078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f1393-cb32-4a62-b448-cafe6a20b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:58.330303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f1393-cb32-4a62-b448-cafe6a20b7ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:58.330816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f1393-cb32-4a62-b448-cafe6a20b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:58.331291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f1393-cb32-4a62-b448-cafe6a20b7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:58.344752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f1393-cb32-4a62-b448-cafe6a20b7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:58.347427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f1393-cb32-4a62-b448-cafe6a20b7ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:58.351287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c4100-9804-4a74-800c-1ab9dfe4116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:58.352587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c4100-9804-4a74-800c-1ab9dfe4116b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:58.352871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c4100-9804-4a74-800c-1ab9dfe4116b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:58.353141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c4100-9804-4a74-800c-1ab9dfe4116b None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:58.354237 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c4100-9804-4a74-800c-1ab9dfe4116b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:58.354619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c4100-9804-4a74-800c-1ab9dfe4116b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:58.356862 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c4100-9804-4a74-800c-1ab9dfe4116b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:58.365630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 408/819] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:00:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:58.366952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c4100-9804-4a74-800c-1ab9dfe4116b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-677f1393-cb32-4a62-b448-cafe6a20b7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:00:58.391860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:58.392899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:58.393824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:00:58.393824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:00:58.393824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:00:58.393824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:58.394241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:58.403207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 412/820] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:58.407400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f1393-cb32-4a62-b448-cafe6a20b7ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:58.534482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:58.577290 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f1393-cb32-4a62-b448-cafe6a20b7ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:58.580302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c4100-9804-4a74-800c-1ab9dfe4116b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:58.619551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725f6e3-82aa-4d02-b6f7-d238b253dca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:58.620572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725f6e3-82aa-4d02-b6f7-d238b253dca6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:58.620855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725f6e3-82aa-4d02-b6f7-d238b253dca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:58.621130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725f6e3-82aa-4d02-b6f7-d238b253dca6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:58.621917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725f6e3-82aa-4d02-b6f7-d238b253dca6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:58.623427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725f6e3-82aa-4d02-b6f7-d238b253dca6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:58.633377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266d4e9-d704-478d-aca2-833ed21337fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:58.634668 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266d4e9-d704-478d-aca2-833ed21337fa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:58.635380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266d4e9-d704-478d-aca2-833ed21337fa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:58.636650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266d4e9-d704-478d-aca2-833ed21337fa None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c725f6e3-82aa-4d02-b6f7-d238b253dca6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:58.637741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:58.639620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 15:00:58.641368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:58.643394 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266d4e9-d704-478d-aca2-833ed21337fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:58.644063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 413/821] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:58 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:58.644296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266d4e9-d704-478d-aca2-833ed21337fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:58.644952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725f6e3-82aa-4d02-b6f7-d238b253dca6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:58.646958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266d4e9-d704-478d-aca2-833ed21337fa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:58.670721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 409/822] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:58.671979 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266d4e9-d704-478d-aca2-833ed21337fa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:58.780725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:58.783243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725f6e3-82aa-4d02-b6f7-d238b253dca6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:58.826032 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac125a-86e8-48be-8621-67fe2ce3a708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:58.826684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac125a-86e8-48be-8621-67fe2ce3a708 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:58.826967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac125a-86e8-48be-8621-67fe2ce3a708 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:58.827245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac125a-86e8-48be-8621-67fe2ce3a708 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:58.828017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac125a-86e8-48be-8621-67fe2ce3a708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:58.828291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac125a-86e8-48be-8621-67fe2ce3a708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:58.829812 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac125a-86e8-48be-8621-67fe2ce3a708 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:58.840112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:58.843087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266d4e9-d704-478d-aca2-833ed21337fa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:58.850991 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 414/823] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:58.852948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac125a-86e8-48be-8621-67fe2ce3a708 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:58.882754 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4ad0-482e-4999-aef4-758deb552997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:58.883441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4ad0-482e-4999-aef4-758deb552997 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:58.883728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4ad0-482e-4999-aef4-758deb552997 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:58.884003 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4ad0-482e-4999-aef4-758deb552997 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:58.884752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c4ad0-482e-4999-aef4-758deb552997 None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:58.885065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c4ad0-482e-4999-aef4-758deb552997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:58.886585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c4ad0-482e-4999-aef4-758deb552997 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:58.898800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 410/824] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:00:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:58.898800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4ad0-482e-4999-aef4-758deb552997 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:58.987554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac125a-86e8-48be-8621-67fe2ce3a708 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:59.024993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4ad0-482e-4999-aef4-758deb552997 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:59.031823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f692df8-3870-4edf-958d-f602a77bcde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:59.033169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f692df8-3870-4edf-958d-f602a77bcde1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:59.033694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f692df8-3870-4edf-958d-f602a77bcde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:59.034170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f692df8-3870-4edf-958d-f602a77bcde1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:59.042855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f692df8-3870-4edf-958d-f602a77bcde1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:59.044460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f692df8-3870-4edf-958d-f602a77bcde1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3f692df8-3870-4edf-958d-f602a77bcde1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:00:59.061334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:59.062616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:00:59.063698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:00:59.068891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 415/825] 10.222.0.90 () {56 vars in 1093 bytes} [Tue Jun 21 15:00:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:59.069926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f692df8-3870-4edf-958d-f602a77bcde1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:59.070744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:59.087045 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addcfd-2d7c-493f-9b05-aa8aba163846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:59.089227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addcfd-2d7c-493f-9b05-aa8aba163846 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:59.089761 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addcfd-2d7c-493f-9b05-aa8aba163846 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:59.090244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addcfd-2d7c-493f-9b05-aa8aba163846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:59.100229 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00addcfd-2d7c-493f-9b05-aa8aba163846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:59.102941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00addcfd-2d7c-493f-9b05-aa8aba163846 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-00addcfd-2d7c-493f-9b05-aa8aba163846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:00:59.124945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:00:59.126377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:00:59.127502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:00:59.127502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:00:59.127502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:00:59.127502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:00:59.127502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:00:59.127502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:00:59.127502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:00:59.127502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:00:59.130134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 411/826] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:00:59.131574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addcfd-2d7c-493f-9b05-aa8aba163846 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:59.143156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:59.194767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f692df8-3870-4edf-958d-f602a77bcde1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:59.238860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dcc6b-6624-4ef2-982e-fed2c987e4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:59.239679 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dcc6b-6624-4ef2-982e-fed2c987e4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:59.240062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dcc6b-6624-4ef2-982e-fed2c987e4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:59.240439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dcc6b-6624-4ef2-982e-fed2c987e4a7 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:59.241260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dcc6b-6624-4ef2-982e-fed2c987e4a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:59.241712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dcc6b-6624-4ef2-982e-fed2c987e4a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:59.243436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dcc6b-6624-4ef2-982e-fed2c987e4a7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:59.254880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 416/827] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:00:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:59.256130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dcc6b-6624-4ef2-982e-fed2c987e4a7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:59.277113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addcfd-2d7c-493f-9b05-aa8aba163846 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:59.317244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f36dc-54d7-4c20-9b72-d4705d2a48b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:59.318146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f36dc-54d7-4c20-9b72-d4705d2a48b1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:59.318589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f36dc-54d7-4c20-9b72-d4705d2a48b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:59.318993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f36dc-54d7-4c20-9b72-d4705d2a48b1 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:59.319993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f36dc-54d7-4c20-9b72-d4705d2a48b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:59.320340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f36dc-54d7-4c20-9b72-d4705d2a48b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:59.321997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f36dc-54d7-4c20-9b72-d4705d2a48b1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:59.345555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 412/828] 10.222.0.90 () {56 vars in 1133 bytes} [Tue Jun 21 15:00:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:59.346613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f36dc-54d7-4c20-9b72-d4705d2a48b1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:59.397905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dcc6b-6624-4ef2-982e-fed2c987e4a7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:59.403201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:59.426637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:59.441200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeec7b-5428-4b6c-97ae-170967136573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:59.442049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeec7b-5428-4b6c-97ae-170967136573 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:59.442629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeec7b-5428-4b6c-97ae-170967136573 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:59.443047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeec7b-5428-4b6c-97ae-170967136573 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:59.443941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbeec7b-5428-4b6c-97ae-170967136573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:00:59.444360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbeec7b-5428-4b6c-97ae-170967136573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:59.446033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbeec7b-5428-4b6c-97ae-170967136573 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:59.460225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 417/829] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:00:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:00:59.461436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeec7b-5428-4b6c-97ae-170967136573 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:59.468463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f36dc-54d7-4c20-9b72-d4705d2a48b1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:59.506143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578373-17c8-4b1f-be29-f9c1ee290ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:59.507222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578373-17c8-4b1f-be29-f9c1ee290ea8 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:59.507716 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578373-17c8-4b1f-be29-f9c1ee290ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:59.508193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578373-17c8-4b1f-be29-f9c1ee290ea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:59.509226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578373-17c8-4b1f-be29-f9c1ee290ea8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:59.511445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578373-17c8-4b1f-be29-f9c1ee290ea8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:59.533883 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 413/830] 10.222.0.90 () {60 vars in 1144 bytes} [Tue Jun 21 15:00:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:00:59.535199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578373-17c8-4b1f-be29-f9c1ee290ea8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:00:59.619387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeec7b-5428-4b6c-97ae-170967136573 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:59.651928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:59.671210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578373-17c8-4b1f-be29-f9c1ee290ea8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:00:59.723681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76858f-c4f7-44c3-9dd2-c5dfa398e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:59.724813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76858f-c4f7-44c3-9dd2-c5dfa398e216 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:59.725313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76858f-c4f7-44c3-9dd2-c5dfa398e216 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:59.725803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76858f-c4f7-44c3-9dd2-c5dfa398e216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:59.795694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aef814-f3b1-41ea-b55f-590187e5ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:00:59.797257 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aef814-f3b1-41ea-b55f-590187e5ff28 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:00:59.797778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aef814-f3b1-41ea-b55f-590187e5ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:00:59.798277 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aef814-f3b1-41ea-b55f-590187e5ff28 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/f0564976d31a4fe79742b978c6bee315/roles/ce176ffaea984efb879ec3a4c2da0742` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:00:59.822616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aef814-f3b1-41ea-b55f-590187e5ff28 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=f0564976d31a4fe79742b978c6bee315, role_id=ce176ffaea984efb879ec3a4c2da0742)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:59.826182 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aef814-f3b1-41ea-b55f-590187e5ff28 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:00:59.829871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:00:59.850645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 414/831] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:00:59 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/f0564976d31a4fe79742b978c6bee315/roles/ce176ffaea984efb879ec3a4c2da0742 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:00:59.862084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76858f-c4f7-44c3-9dd2-c5dfa398e216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:00:59.864461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76858f-c4f7-44c3-9dd2-c5dfa398e216 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:00.085663 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 418/832] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:00:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:01:00.093206 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aef814-f3b1-41ea-b55f-590187e5ff28 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:00.242987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aef814-f3b1-41ea-b55f-590187e5ff28 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:00.259372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2518-49c4-4168-9bc5-be760921c7c8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:00.259715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2518-49c4-4168-9bc5-be760921c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:00.260031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2518-49c4-4168-9bc5-be760921c7c8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:00.261841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 419/833] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:00.267010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08b95-e426-4425-af75-58f47f118a8c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:00.267294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08b95-e426-4425-af75-58f47f118a8c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:00.267577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08b95-e426-4425-af75-58f47f118a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:00.286098 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09898fe4-5b7c-40a4-9800-e8c274911172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:00.287278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09898fe4-5b7c-40a4-9800-e8c274911172 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:00.287803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09898fe4-5b7c-40a4-9800-e8c274911172 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:00.288305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09898fe4-5b7c-40a4-9800-e8c274911172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:00.289153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c9c08b95-e426-4425-af75-58f47f118a8c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:00.291129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c9c08b95-e426-4425-af75-58f47f118a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:00.302812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09898fe4-5b7c-40a4-9800-e8c274911172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:00.305289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09898fe4-5b7c-40a4-9800-e8c274911172 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:00.326998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-09898fe4-5b7c-40a4-9800-e8c274911172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:00.333056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:00.334119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:00.335572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:00.335572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:00.335572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:00.335572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:00.340103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 415/834] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:00.341798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09898fe4-5b7c-40a4-9800-e8c274911172 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:00.411107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 420/835] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:00.439828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08b95-e426-4425-af75-58f47f118a8c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:00.460592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:00.470180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09898fe4-5b7c-40a4-9800-e8c274911172 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:00.510055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bdb78-aad2-4ce7-b992-ab570ce2e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:00.511136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bdb78-aad2-4ce7-b992-ab570ce2e00c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:00.511813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bdb78-aad2-4ce7-b992-ab570ce2e00c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:00.512158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bdb78-aad2-4ce7-b992-ab570ce2e00c None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:00.513012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bdb78-aad2-4ce7-b992-ab570ce2e00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:00.513328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bdb78-aad2-4ce7-b992-ab570ce2e00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:00.514739 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bdb78-aad2-4ce7-b992-ab570ce2e00c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:00.533837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 416/836] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:00.535691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bdb78-aad2-4ce7-b992-ab570ce2e00c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:00.577106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08b95-e426-4425-af75-58f47f118a8c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:00.605877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:00.628604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de954a-4524-4b49-9948-d0b9b965464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:00.629418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de954a-4524-4b49-9948-d0b9b965464a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:00.629737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de954a-4524-4b49-9948-d0b9b965464a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:00.630019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de954a-4524-4b49-9948-d0b9b965464a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:00.646547 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de954a-4524-4b49-9948-d0b9b965464a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a8de954a-4524-4b49-9948-d0b9b965464a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:00.658365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:00.659378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:00.660241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:00.661821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bdb78-aad2-4ce7-b992-ab570ce2e00c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:00.664660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 421/837] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:00.666531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de954a-4524-4b49-9948-d0b9b965464a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:00.706965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834aec-3b4b-42dd-90fc-9b186641b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:00.707795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834aec-3b4b-42dd-90fc-9b186641b311 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:00.708078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834aec-3b4b-42dd-90fc-9b186641b311 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:00.708357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834aec-3b4b-42dd-90fc-9b186641b311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:00.717071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8834aec-3b4b-42dd-90fc-9b186641b311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:00.718574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8834aec-3b4b-42dd-90fc-9b186641b311 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c8834aec-3b4b-42dd-90fc-9b186641b311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:00.735339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:00.736337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:00.737264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:00.737264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:00.737264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:00.737264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:00.737264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:00.737264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:00.737264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:00.737264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:00.741311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 417/838] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:00.742368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834aec-3b4b-42dd-90fc-9b186641b311 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:00.762923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:00.795933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de954a-4524-4b49-9948-d0b9b965464a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:00.832294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844040d0-d050-44b1-8854-55b7a2634943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:00.833243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844040d0-d050-44b1-8854-55b7a2634943 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:00.833713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844040d0-d050-44b1-8854-55b7a2634943 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:00.834134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844040d0-d050-44b1-8854-55b7a2634943 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:00.835018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844040d0-d050-44b1-8854-55b7a2634943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:00.835480 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844040d0-d050-44b1-8854-55b7a2634943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:00.836991 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844040d0-d050-44b1-8854-55b7a2634943 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:00.847018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 422/839] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:00.852655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844040d0-d050-44b1-8854-55b7a2634943 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:00.868204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834aec-3b4b-42dd-90fc-9b186641b311 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:00.894755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:00.920022 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8956060-0df0-4579-9a42-fbf1908b1032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:00.920861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8956060-0df0-4579-9a42-fbf1908b1032 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:00.921266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8956060-0df0-4579-9a42-fbf1908b1032 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:00.921690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8956060-0df0-4579-9a42-fbf1908b1032 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:00.922661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8956060-0df0-4579-9a42-fbf1908b1032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:00.923117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8956060-0df0-4579-9a42-fbf1908b1032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:00.925549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8956060-0df0-4579-9a42-fbf1908b1032 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:00.950949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 418/840] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:01:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:00.952452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8956060-0df0-4579-9a42-fbf1908b1032 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:01.010317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844040d0-d050-44b1-8854-55b7a2634943 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:01.065820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3835-2995-49f7-955f-ec803bb1bf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:01.066544 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3835-2995-49f7-955f-ec803bb1bf8f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:01.066831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3835-2995-49f7-955f-ec803bb1bf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:01.067109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3835-2995-49f7-955f-ec803bb1bf8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:01.070262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:01.083035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3835-2995-49f7-955f-ec803bb1bf8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:01.084857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3835-2995-49f7-955f-ec803bb1bf8f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:01.097589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8956060-0df0-4579-9a42-fbf1908b1032 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cd7c3835-2995-49f7-955f-ec803bb1bf8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:01.104948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:01.106606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:01.107518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:01.107518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:01.107518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:01.107518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:01.114733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 423/841] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:01.115344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4096-8e2d-4631-b68c-626dfcb277b2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:01.115344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4096-8e2d-4631-b68c-626dfcb277b2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:01.115631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4096-8e2d-4631-b68c-626dfcb277b2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:01.117035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 424/842] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:01.119641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c4096-8e2d-4631-b68c-626dfcb277b2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:01.137728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0747559-fb4f-43d5-8bed-2fec6b9259ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:01.139086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0747559-fb4f-43d5-8bed-2fec6b9259ca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:01.139265 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0747559-fb4f-43d5-8bed-2fec6b9259ca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:01.139541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0747559-fb4f-43d5-8bed-2fec6b9259ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:01.140375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0747559-fb4f-43d5-8bed-2fec6b9259ca None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=2bd3ffc0a30648139b2cbf19bb6bd535) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:01.140769 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0747559-fb4f-43d5-8bed-2fec6b9259ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:01.142159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0747559-fb4f-43d5-8bed-2fec6b9259ca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:01.157502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 419/843] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:00 2022] GET /identity/v3/role_assignments?user.id=2bd3ffc0a30648139b2cbf19bb6bd535&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:01.157502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389b7ad-df10-4d58-a69a-e4298e68cb20 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:01.157502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389b7ad-df10-4d58-a69a-e4298e68cb20 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:01.157502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389b7ad-df10-4d58-a69a-e4298e68cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:01.183489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0389b7ad-df10-4d58-a69a-e4298e68cb20 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:01.185208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0389b7ad-df10-4d58-a69a-e4298e68cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:01.231837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:01.259109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c4096-8e2d-4631-b68c-626dfcb277b2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:01.304153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1c9fb-6b6f-404f-8755-32e265dfdc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:01.305019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1c9fb-6b6f-404f-8755-32e265dfdc37 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:01.305458 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1c9fb-6b6f-404f-8755-32e265dfdc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:01.305915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1c9fb-6b6f-404f-8755-32e265dfdc37 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:01.306891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1c9fb-6b6f-404f-8755-32e265dfdc37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:01.307273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1c9fb-6b6f-404f-8755-32e265dfdc37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:01.309654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1c9fb-6b6f-404f-8755-32e265dfdc37 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:01.328989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 425/844] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:01.330072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1c9fb-6b6f-404f-8755-32e265dfdc37 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:01.396184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:01.409960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 420/845] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:01.434997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389b7ad-df10-4d58-a69a-e4298e68cb20 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:01.496570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1c9fb-6b6f-404f-8755-32e265dfdc37 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:01.558029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503081d4-b88c-4d5f-a060-4ba04c49008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:01.558832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503081d4-b88c-4d5f-a060-4ba04c49008a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:01.559120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503081d4-b88c-4d5f-a060-4ba04c49008a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:01.559402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503081d4-b88c-4d5f-a060-4ba04c49008a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:01.567107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503081d4-b88c-4d5f-a060-4ba04c49008a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:01.568588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503081d4-b88c-4d5f-a060-4ba04c49008a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:01.572573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389b7ad-df10-4d58-a69a-e4298e68cb20 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-503081d4-b88c-4d5f-a060-4ba04c49008a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:01:01.584701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:01.585924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:01.587064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 426/846] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:01:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:01.592693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503081d4-b88c-4d5f-a060-4ba04c49008a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:01.614185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04681f88-3f9c-402d-85e5-7a7e48f313d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:01.615093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04681f88-3f9c-402d-85e5-7a7e48f313d5 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:01.615550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04681f88-3f9c-402d-85e5-7a7e48f313d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:01.615992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04681f88-3f9c-402d-85e5-7a7e48f313d5 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:01.616895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04681f88-3f9c-402d-85e5-7a7e48f313d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:01.618486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04681f88-3f9c-402d-85e5-7a7e48f313d5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:01.638699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 421/847] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:01:01 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:01:01.741047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503081d4-b88c-4d5f-a060-4ba04c49008a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:01.753516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:01.826781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953f7b0-b2ae-4d96-bb04-39a604674e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:01.827475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953f7b0-b2ae-4d96-bb04-39a604674e69 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:01.827758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953f7b0-b2ae-4d96-bb04-39a604674e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:01.828034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953f7b0-b2ae-4d96-bb04-39a604674e69 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:01.828874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953f7b0-b2ae-4d96-bb04-39a604674e69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:01.829182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953f7b0-b2ae-4d96-bb04-39a604674e69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:01.831523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953f7b0-b2ae-4d96-bb04-39a604674e69 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:01.850649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 427/848] 10.222.0.90 () {56 vars in 1135 bytes} [Tue Jun 21 15:01:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:01.857616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04681f88-3f9c-402d-85e5-7a7e48f313d5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:01.895089 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:01.976236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04681f88-3f9c-402d-85e5-7a7e48f313d5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:02.017618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bb53-5e26-4da2-865f-5106f3751071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:02.018351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bb53-5e26-4da2-865f-5106f3751071 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:02.018637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bb53-5e26-4da2-865f-5106f3751071 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:02.018969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bb53-5e26-4da2-865f-5106f3751071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:02.097374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8bb53-5e26-4da2-865f-5106f3751071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:02.099012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8bb53-5e26-4da2-865f-5106f3751071 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:02.150422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:02.244285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 422/849] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:01 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:01:02.250177 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953f7b0-b2ae-4d96-bb04-39a604674e69 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:02.309601 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0e0d5-5559-4be3-b02a-ebfaa787a6bf None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:02.309978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0e0d5-5559-4be3-b02a-ebfaa787a6bf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:02.310355 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0e0d5-5559-4be3-b02a-ebfaa787a6bf None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:02.312313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 423/850] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:02.318940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fdce7-65d9-442f-9d0f-e61d652cba29 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:02.319435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fdce7-65d9-442f-9d0f-e61d652cba29 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:02.319903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fdce7-65d9-442f-9d0f-e61d652cba29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:02.338419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-409fdce7-65d9-442f-9d0f-e61d652cba29 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:02.339971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-409fdce7-65d9-442f-9d0f-e61d652cba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:02.379887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953f7b0-b2ae-4d96-bb04-39a604674e69 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:02.426251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c332714-e6cf-4e20-8565-e39cf3be3e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:02.427487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c332714-e6cf-4e20-8565-e39cf3be3e0d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:02.427987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c332714-e6cf-4e20-8565-e39cf3be3e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:02.428494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c332714-e6cf-4e20-8565-e39cf3be3e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:02.434437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 424/851] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:02.442768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c332714-e6cf-4e20-8565-e39cf3be3e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:02.444533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c332714-e6cf-4e20-8565-e39cf3be3e0d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:02.453340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fdce7-65d9-442f-9d0f-e61d652cba29 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0c332714-e6cf-4e20-8565-e39cf3be3e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:02.469387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:02.470380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:02.471343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:02.471343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:02.471343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:02.471343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:02.473548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 428/852] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:02.477281 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c332714-e6cf-4e20-8565-e39cf3be3e0d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:02.497391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:02.535665 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:02.588276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fdce7-65d9-442f-9d0f-e61d652cba29 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:02.629777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6d7e8-2e07-4759-bb2e-c1a66f7c1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:02.630641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6d7e8-2e07-4759-bb2e-c1a66f7c1d73 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:02.630926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6d7e8-2e07-4759-bb2e-c1a66f7c1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:02.631200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6d7e8-2e07-4759-bb2e-c1a66f7c1d73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:02.644438 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6d7e8-2e07-4759-bb2e-c1a66f7c1d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0ef6d7e8-2e07-4759-bb2e-c1a66f7c1d73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:02.653048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:02.654380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:01:02.655459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:02.659226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 425/853] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:01:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:02.660627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6d7e8-2e07-4759-bb2e-c1a66f7c1d73 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:02.737983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c332714-e6cf-4e20-8565-e39cf3be3e0d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:02.775783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6649e2d-e5cf-4e21-b01e-f085062c6da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:02.776740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6649e2d-e5cf-4e21-b01e-f085062c6da0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:02.777180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6649e2d-e5cf-4e21-b01e-f085062c6da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:02.777754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6649e2d-e5cf-4e21-b01e-f085062c6da0 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:02.778744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6649e2d-e5cf-4e21-b01e-f085062c6da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:02.779218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6649e2d-e5cf-4e21-b01e-f085062c6da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:02.780855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6649e2d-e5cf-4e21-b01e-f085062c6da0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:02.787913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6d7e8-2e07-4759-bb2e-c1a66f7c1d73 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:02.794789 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 429/854] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:02.800361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6649e2d-e5cf-4e21-b01e-f085062c6da0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:02.824251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:02.840458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4d9b-08ee-43ea-8da4-74c35706aefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:02.841327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4d9b-08ee-43ea-8da4-74c35706aefe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:02.841733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4d9b-08ee-43ea-8da4-74c35706aefe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:02.842110 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4d9b-08ee-43ea-8da4-74c35706aefe None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:02.843232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4d9b-08ee-43ea-8da4-74c35706aefe None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:02.844500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4d9b-08ee-43ea-8da4-74c35706aefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:02.846017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4d9b-08ee-43ea-8da4-74c35706aefe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:02.857625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 426/855] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:01:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:02.862766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4d9b-08ee-43ea-8da4-74c35706aefe None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:02.889398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:02.935211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6649e2d-e5cf-4e21-b01e-f085062c6da0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:02.973750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de407ff1-b3cb-48a9-b2ab-8c3e2ebf10c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:02.974860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de407ff1-b3cb-48a9-b2ab-8c3e2ebf10c9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:02.975340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de407ff1-b3cb-48a9-b2ab-8c3e2ebf10c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:02.975801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de407ff1-b3cb-48a9-b2ab-8c3e2ebf10c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:02.983993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de407ff1-b3cb-48a9-b2ab-8c3e2ebf10c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:02.986012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de407ff1-b3cb-48a9-b2ab-8c3e2ebf10c9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:02.994919 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4d9b-08ee-43ea-8da4-74c35706aefe None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-de407ff1-b3cb-48a9-b2ab-8c3e2ebf10c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:03.001937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:03.002871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:03.003825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:03.003825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:03.003825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:03.003825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:03.003825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:03.003825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:03.003825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:03.003825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:03.006525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 430/856] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:03.014061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de407ff1-b3cb-48a9-b2ab-8c3e2ebf10c9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:03.037184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733d61d-55ad-4434-a673-ca1f937b9a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:03.038415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733d61d-55ad-4434-a673-ca1f937b9a7f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.038915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733d61d-55ad-4434-a673-ca1f937b9a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.039406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733d61d-55ad-4434-a673-ca1f937b9a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.052187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733d61d-55ad-4434-a673-ca1f937b9a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:03.054038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733d61d-55ad-4434-a673-ca1f937b9a7f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4733d61d-55ad-4434-a673-ca1f937b9a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:03.072391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:03.074525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:03.075450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:03.075450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:03.075450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:03.075450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:03.078027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 427/857] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:03.084423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733d61d-55ad-4434-a673-ca1f937b9a7f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:03.132212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:03.138185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de407ff1-b3cb-48a9-b2ab-8c3e2ebf10c9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:03.190896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:03.198403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0ca55-5418-417d-801c-5c167d3ecfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:03.199438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0ca55-5418-417d-801c-5c167d3ecfcb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.200020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0ca55-5418-417d-801c-5c167d3ecfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.200513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0ca55-5418-417d-801c-5c167d3ecfcb None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.201564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0ca55-5418-417d-801c-5c167d3ecfcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:03.202093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0ca55-5418-417d-801c-5c167d3ecfcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:03.204090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0ca55-5418-417d-801c-5c167d3ecfcb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:03.218503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733d61d-55ad-4434-a673-ca1f937b9a7f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:03.227966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 431/858] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:03.229676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0ca55-5418-417d-801c-5c167d3ecfcb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:03.267623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005de0a5-11c2-4f73-8455-040943fa0e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:03.270497 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005de0a5-11c2-4f73-8455-040943fa0e8a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.270786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005de0a5-11c2-4f73-8455-040943fa0e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.271101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005de0a5-11c2-4f73-8455-040943fa0e8a None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.272770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005de0a5-11c2-4f73-8455-040943fa0e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:03.273087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005de0a5-11c2-4f73-8455-040943fa0e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:03.274506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005de0a5-11c2-4f73-8455-040943fa0e8a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:03.293563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 428/859] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:03.298238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005de0a5-11c2-4f73-8455-040943fa0e8a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:03.353910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0ca55-5418-417d-801c-5c167d3ecfcb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:03.398159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43508682-f9c4-4e6a-9628-d9784033db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:03.399243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43508682-f9c4-4e6a-9628-d9784033db75 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.399536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43508682-f9c4-4e6a-9628-d9784033db75 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.399818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43508682-f9c4-4e6a-9628-d9784033db75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.400931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43508682-f9c4-4e6a-9628-d9784033db75 None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=8ebffb0a0cf04bc0809a94ddd3a347b9) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:03.401374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43508682-f9c4-4e6a-9628-d9784033db75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:03.403305 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43508682-f9c4-4e6a-9628-d9784033db75 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:03.411689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 432/860] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:03 2022] GET /identity/v3/role_assignments?user.id=8ebffb0a0cf04bc0809a94ddd3a347b9&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:03.420614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005de0a5-11c2-4f73-8455-040943fa0e8a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:03.429723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:03.461732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985dd3f-fdc6-439f-bb43-109276f89890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:03.462563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985dd3f-fdc6-439f-bb43-109276f89890 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.462904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985dd3f-fdc6-439f-bb43-109276f89890 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.463189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985dd3f-fdc6-439f-bb43-109276f89890 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.472343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985dd3f-fdc6-439f-bb43-109276f89890 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:03.473877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985dd3f-fdc6-439f-bb43-109276f89890 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b985dd3f-fdc6-439f-bb43-109276f89890 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:01:03.490742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:03.491775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:01:03.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:03.497722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 429/861] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:01:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:03.499133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43508682-f9c4-4e6a-9628-d9784033db75 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:03.559186 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b512-650e-4215-9ea7-ccc4cc2fd1cf None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.559483 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b512-650e-4215-9ea7-ccc4cc2fd1cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.559677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b512-650e-4215-9ea7-ccc4cc2fd1cf None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.561343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 430/862] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:03.566863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3abd2-4e7b-4d76-ae79-f3c6cf1537e8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.567154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3abd2-4e7b-4d76-ae79-f3c6cf1537e8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.567433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3abd2-4e7b-4d76-ae79-f3c6cf1537e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.569071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:03.587215 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2cf3abd2-4e7b-4d76-ae79-f3c6cf1537e8 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:03.588432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2cf3abd2-4e7b-4d76-ae79-f3c6cf1537e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:03.626274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43508682-f9c4-4e6a-9628-d9784033db75 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:03.670604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccfb80-d127-4607-b6e4-a72c7dfc008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:03.671652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccfb80-d127-4607-b6e4-a72c7dfc008c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.672174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccfb80-d127-4607-b6e4-a72c7dfc008c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.672677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccfb80-d127-4607-b6e4-a72c7dfc008c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.673793 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccfb80-d127-4607-b6e4-a72c7dfc008c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:03.674417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccfb80-d127-4607-b6e4-a72c7dfc008c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:03.676126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccfb80-d127-4607-b6e4-a72c7dfc008c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:03.676837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 431/863] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:03.697000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 433/864] 10.222.0.90 () {56 vars in 1149 bytes} [Tue Jun 21 15:01:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:03.700892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3abd2-4e7b-4d76-ae79-f3c6cf1537e8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:03.703595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccfb80-d127-4607-b6e4-a72c7dfc008c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:03.794892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:03.812715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3abd2-4e7b-4d76-ae79-f3c6cf1537e8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:03.814719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccfb80-d127-4607-b6e4-a72c7dfc008c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:03.837844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:03.851365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2721988-2075-475b-8c77-09c7ff096caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:03.852252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2721988-2075-475b-8c77-09c7ff096caf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.852611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2721988-2075-475b-8c77-09c7ff096caf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.852962 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2721988-2075-475b-8c77-09c7ff096caf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.853796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2721988-2075-475b-8c77-09c7ff096caf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:03.856446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2721988-2075-475b-8c77-09c7ff096caf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:03.861937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe779342-799e-473a-b7e0-ce1e4931bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:03.862852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe779342-799e-473a-b7e0-ce1e4931bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:03.863326 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe779342-799e-473a-b7e0-ce1e4931bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:03.863793 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe779342-799e-473a-b7e0-ce1e4931bbe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d2721988-2075-475b-8c77-09c7ff096caf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:03.869786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:03.871446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:01:03.872294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:03.877286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 432/865] 10.222.0.90 () {56 vars in 1132 bytes} [Tue Jun 21 15:01:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:03.878270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2721988-2075-475b-8c77-09c7ff096caf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:03.976293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe779342-799e-473a-b7e0-ce1e4931bbe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:03.978328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe779342-799e-473a-b7e0-ce1e4931bbe1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:04.003906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2721988-2075-475b-8c77-09c7ff096caf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:04.052597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff2fd-84b0-4867-b216-d4c1cf85b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:04.054236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff2fd-84b0-4867-b216-d4c1cf85b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.054528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff2fd-84b0-4867-b216-d4c1cf85b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.054810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ff2fd-84b0-4867-b216-d4c1cf85b7f9 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.055534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ff2fd-84b0-4867-b216-d4c1cf85b7f9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:04.055848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ff2fd-84b0-4867-b216-d4c1cf85b7f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:04.057310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ff2fd-84b0-4867-b216-d4c1cf85b7f9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:04.069361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 433/866] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:04.070059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff2fd-84b0-4867-b216-d4c1cf85b7f9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:04.088122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:04.110041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 434/867] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:03 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:01:04.111204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe779342-799e-473a-b7e0-ce1e4931bbe1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:04.128489 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:04.205371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ff2fd-84b0-4867-b216-d4c1cf85b7f9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:04.238200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe779342-799e-473a-b7e0-ce1e4931bbe1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:04.249428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f0449-30f1-4d82-847e-8a6cb4eb71bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:04.250790 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f0449-30f1-4d82-847e-8a6cb4eb71bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.251287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f0449-30f1-4d82-847e-8a6cb4eb71bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.252039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f0449-30f1-4d82-847e-8a6cb4eb71bc None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.253234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f0449-30f1-4d82-847e-8a6cb4eb71bc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:04.253752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f0449-30f1-4d82-847e-8a6cb4eb71bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:04.255857 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f0449-30f1-4d82-847e-8a6cb4eb71bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:04.262136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 434/868] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:04.284427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd43d4d-d66d-4dfc-a87c-b6f4d754e8d9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.284785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd43d4d-d66d-4dfc-a87c-b6f4d754e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.285031 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd43d4d-d66d-4dfc-a87c-b6f4d754e8d9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.287394 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 435/869] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:04.288898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bd074-c528-4599-a2f7-f5165491d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:04.290018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd074-c528-4599-a2f7-f5165491d31f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.290541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd074-c528-4599-a2f7-f5165491d31f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.291083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd074-c528-4599-a2f7-f5165491d31f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.293942 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2628-9def-4a1c-9212-fad50fd566f2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.294239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2628-9def-4a1c-9212-fad50fd566f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.294529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b2628-9def-4a1c-9212-fad50fd566f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.307005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bd074-c528-4599-a2f7-f5165491d31f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:04.309458 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bd074-c528-4599-a2f7-f5165491d31f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:04.312946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f42b2628-9def-4a1c-9212-fad50fd566f2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:04.313902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f42b2628-9def-4a1c-9212-fad50fd566f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-907bd074-c528-4599-a2f7-f5165491d31f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:04.332070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:04.333051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:04.334003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:04.334003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:04.334003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:04.334003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:04.337830 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 435/870] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:04.339911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bd074-c528-4599-a2f7-f5165491d31f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:04.410511 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 436/871] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:04.435607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:04.443239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2628-9def-4a1c-9212-fad50fd566f2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:04.455212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:04.484588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bd074-c528-4599-a2f7-f5165491d31f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:04.536956 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd214-abea-4333-84bd-4e42cc6dbf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:04.538595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd214-abea-4333-84bd-4e42cc6dbf45 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.539114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd214-abea-4333-84bd-4e42cc6dbf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.539916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd214-abea-4333-84bd-4e42cc6dbf45 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.541664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd214-abea-4333-84bd-4e42cc6dbf45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:04.542787 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd214-abea-4333-84bd-4e42cc6dbf45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:04.545578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd214-abea-4333-84bd-4e42cc6dbf45 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:04.562648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 436/872] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:04.570449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd214-abea-4333-84bd-4e42cc6dbf45 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:04.586455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b2628-9def-4a1c-9212-fad50fd566f2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:04.625859 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7aa09-b1e2-4c03-baf9-497d401fe1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:04.626698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7aa09-b1e2-4c03-baf9-497d401fe1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.626988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7aa09-b1e2-4c03-baf9-497d401fe1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.627313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7aa09-b1e2-4c03-baf9-497d401fe1f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.628088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7aa09-b1e2-4c03-baf9-497d401fe1f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:04.629496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7aa09-b1e2-4c03-baf9-497d401fe1f3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-dcf7aa09-b1e2-4c03-baf9-497d401fe1f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:04.645915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:04.647026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:01:04.647899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:04.656125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 437/873] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:01:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:04.657456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7aa09-b1e2-4c03-baf9-497d401fe1f3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:04.699913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd214-abea-4333-84bd-4e42cc6dbf45 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:04.728706 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:04.740853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a2f29-4023-4a10-9ba7-51d07727da77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:04.741657 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:04.742262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a2f29-4023-4a10-9ba7-51d07727da77 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.742992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a2f29-4023-4a10-9ba7-51d07727da77 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.743669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a2f29-4023-4a10-9ba7-51d07727da77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.753096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a2f29-4023-4a10-9ba7-51d07727da77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:04.754991 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a2f29-4023-4a10-9ba7-51d07727da77 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-172a2f29-4023-4a10-9ba7-51d07727da77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:04.771154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:04.772267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:04.773171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:04.773171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:04.773171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:04.773171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:04.773171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:04.773171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:04.773171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:04.773171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:04.773171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 437/874] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:04.779724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7aa09-b1e2-4c03-baf9-497d401fe1f3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:04.779887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a2f29-4023-4a10-9ba7-51d07727da77 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:04.816132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13431338-c137-411e-beae-adb9f2fec653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:04.816872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13431338-c137-411e-beae-adb9f2fec653 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.817161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13431338-c137-411e-beae-adb9f2fec653 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.817491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13431338-c137-411e-beae-adb9f2fec653 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.818258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13431338-c137-411e-beae-adb9f2fec653 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:04.818573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13431338-c137-411e-beae-adb9f2fec653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:04.820040 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13431338-c137-411e-beae-adb9f2fec653 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:04.827015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 438/875] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:01:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:04.832204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13431338-c137-411e-beae-adb9f2fec653 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:04.908830 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a2f29-4023-4a10-9ba7-51d07727da77 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:04.956079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057b476-8f0f-4a79-a840-628788f1a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:04.956747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057b476-8f0f-4a79-a840-628788f1a262 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:04.957034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057b476-8f0f-4a79-a840-628788f1a262 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:04.957315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057b476-8f0f-4a79-a840-628788f1a262 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:04.958186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057b476-8f0f-4a79-a840-628788f1a262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:04.958531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057b476-8f0f-4a79-a840-628788f1a262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:04.960069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057b476-8f0f-4a79-a840-628788f1a262 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:04.981231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 438/876] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:04.981419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13431338-c137-411e-beae-adb9f2fec653 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:04.982739 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057b476-8f0f-4a79-a840-628788f1a262 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:05.018245 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fc335-bd67-4546-a8b7-5bbebdbc9a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:05.018969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fc335-bd67-4546-a8b7-5bbebdbc9a21 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:05.019240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fc335-bd67-4546-a8b7-5bbebdbc9a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:05.019579 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fc335-bd67-4546-a8b7-5bbebdbc9a21 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:05.020296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fc335-bd67-4546-a8b7-5bbebdbc9a21 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:05.020610 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fc335-bd67-4546-a8b7-5bbebdbc9a21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:05.022520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fc335-bd67-4546-a8b7-5bbebdbc9a21 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:05.024713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:05.035177 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 439/877] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:01:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:05.036207 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fc335-bd67-4546-a8b7-5bbebdbc9a21 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:05.046275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:05.108731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057b476-8f0f-4a79-a840-628788f1a262 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:05.146749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df0e39-7de9-4d81-bea6-bde015300cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:05.147581 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df0e39-7de9-4d81-bea6-bde015300cfb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:05.148193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df0e39-7de9-4d81-bea6-bde015300cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:05.148720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df0e39-7de9-4d81-bea6-bde015300cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:05.149997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df0e39-7de9-4d81-bea6-bde015300cfb None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=f0564976d31a4fe79742b978c6bee315) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:05.150211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df0e39-7de9-4d81-bea6-bde015300cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:05.152347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df0e39-7de9-4d81-bea6-bde015300cfb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:05.165983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 439/878] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:04 2022] GET /identity/v3/role_assignments?user.id=f0564976d31a4fe79742b978c6bee315&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:05.168978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fc335-bd67-4546-a8b7-5bbebdbc9a21 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:05.213367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ced687-40af-47ac-8f22-b6d0322d422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:05.214697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced687-40af-47ac-8f22-b6d0322d422a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:05.214973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced687-40af-47ac-8f22-b6d0322d422a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:05.215182 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced687-40af-47ac-8f22-b6d0322d422a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:05.215962 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ced687-40af-47ac-8f22-b6d0322d422a None admin] RBAC: Adding query filter params (interface=public, service_id=7d4cf31aebbe4a1392bf1d35fc5d4006, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:05.216276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ced687-40af-47ac-8f22-b6d0322d422a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:05.217698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ced687-40af-47ac-8f22-b6d0322d422a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:05.224492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 440/879] 10.222.0.90 () {56 vars in 1251 bytes} [Tue Jun 21 15:01:05 2022] GET /identity/v3/endpoints?service_id=7d4cf31aebbe4a1392bf1d35fc5d4006&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:05.230653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df0e39-7de9-4d81-bea6-bde015300cfb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:05.352108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df0e39-7de9-4d81-bea6-bde015300cfb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:05.365537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:05.392337 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb9cc3-96ff-4872-a025-3db0dd907306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:05.393102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9cc3-96ff-4872-a025-3db0dd907306 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:05.393384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9cc3-96ff-4872-a025-3db0dd907306 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:05.393679 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb9cc3-96ff-4872-a025-3db0dd907306 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:05.394360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb9cc3-96ff-4872-a025-3db0dd907306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:05.396132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb9cc3-96ff-4872-a025-3db0dd907306 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:05.403029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 440/880] 10.222.0.90 () {56 vars in 1087 bytes} [Tue Jun 21 15:01:05 2022] GET /identity/v3/services => generated 1011 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:01:05.634168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4987-c6a5-4ea8-bfc4-727991b2796f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:05.634573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4987-c6a5-4ea8-bfc4-727991b2796f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:05.634806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc4987-c6a5-4ea8-bfc4-727991b2796f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:05.636801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 441/881] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:05.642548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e411ea-3b73-450d-8737-cdfd40c4a66e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:05.643412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e411ea-3b73-450d-8737-cdfd40c4a66e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:05.643929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e411ea-3b73-450d-8737-cdfd40c4a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:05.664629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-82e411ea-3b73-450d-8737-cdfd40c4a66e None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:05.666331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82e411ea-3b73-450d-8737-cdfd40c4a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:05.744704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 441/882] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:05.767004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4987-c6a5-4ea8-bfc4-727991b2796f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:05.834032 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:05.881018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc4987-c6a5-4ea8-bfc4-727991b2796f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:05.919861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d0bf3-49c1-4c52-8c88-376dd566c970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:05.919861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0bf3-49c1-4c52-8c88-376dd566c970 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:05.919861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0bf3-49c1-4c52-8c88-376dd566c970 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:05.919861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d0bf3-49c1-4c52-8c88-376dd566c970 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:05.920416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d0bf3-49c1-4c52-8c88-376dd566c970 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:05.921620 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d0bf3-49c1-4c52-8c88-376dd566c970 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-787d0bf3-49c1-4c52-8c88-376dd566c970 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:05.944887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:05.946743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:05.948897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:05.951324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 442/883] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:05.959792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e411ea-3b73-450d-8737-cdfd40c4a66e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:06.076184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e411ea-3b73-450d-8737-cdfd40c4a66e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:06.078997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:06.116297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896830a-e709-4cd4-9ca9-a7b244d4d0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:06.117327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896830a-e709-4cd4-9ca9-a7b244d4d0ed None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:06.117896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896830a-e709-4cd4-9ca9-a7b244d4d0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:06.118378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896830a-e709-4cd4-9ca9-a7b244d4d0ed None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:06.119308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896830a-e709-4cd4-9ca9-a7b244d4d0ed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:06.120374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896830a-e709-4cd4-9ca9-a7b244d4d0ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:06.122272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896830a-e709-4cd4-9ca9-a7b244d4d0ed None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:06.127944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 442/884] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:06.133570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d0bf3-49c1-4c52-8c88-376dd566c970 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:06.277843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d0bf3-49c1-4c52-8c88-376dd566c970 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:06.306104 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:06.314806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb384-cf35-4dd0-a66e-7e8e4faac909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:06.315767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb384-cf35-4dd0-a66e-7e8e4faac909 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:06.316315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb384-cf35-4dd0-a66e-7e8e4faac909 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:06.316920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb384-cf35-4dd0-a66e-7e8e4faac909 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:06.317883 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cb384-cf35-4dd0-a66e-7e8e4faac909 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:06.318487 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cb384-cf35-4dd0-a66e-7e8e4faac909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:06.320362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cb384-cf35-4dd0-a66e-7e8e4faac909 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:06.327114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 443/885] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:06.410327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3ba19-9036-41a1-9696-d571b6499cc9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:06.411201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3ba19-9036-41a1-9696-d571b6499cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:06.411910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3ba19-9036-41a1-9696-d571b6499cc9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:06.414268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 443/886] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:06.420230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b98b2-957b-482f-9b93-ad53d9ade172 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:06.420528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b98b2-957b-482f-9b93-ad53d9ade172 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:06.420840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b98b2-957b-482f-9b93-ad53d9ade172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:06.439064 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3a7b98b2-957b-482f-9b93-ad53d9ade172 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:06.440289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3a7b98b2-957b-482f-9b93-ad53d9ade172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:06.517358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 444/887] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:06.540860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3ba19-9036-41a1-9696-d571b6499cc9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:06.665150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3ba19-9036-41a1-9696-d571b6499cc9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:06.706022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd922a-2328-420a-8284-8976e6a444d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:06.706695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd922a-2328-420a-8284-8976e6a444d0 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:06.706987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd922a-2328-420a-8284-8976e6a444d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:06.707272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd922a-2328-420a-8284-8976e6a444d0 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:06.708007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd922a-2328-420a-8284-8976e6a444d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:06.709370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd922a-2328-420a-8284-8976e6a444d0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:06.726359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 444/888] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:01:06 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:07.550346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e45b5-64e7-436e-b0d4-d7829c0f185c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:07.550899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e45b5-64e7-436e-b0d4-d7829c0f185c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:07.550899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e45b5-64e7-436e-b0d4-d7829c0f185c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:07.552433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 445/889] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:07.558050 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcde132-32ed-4be4-9f6a-3e054234d9f0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:07.558340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcde132-32ed-4be4-9f6a-3e054234d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:07.558618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcde132-32ed-4be4-9f6a-3e054234d9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:07.575557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0dcde132-32ed-4be4-9f6a-3e054234d9f0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:07.576745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0dcde132-32ed-4be4-9f6a-3e054234d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:07.600793 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:07.662598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 445/890] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:07.687272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e45b5-64e7-436e-b0d4-d7829c0f185c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:07.811768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e45b5-64e7-436e-b0d4-d7829c0f185c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:07.835643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:07.847604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470517e-e505-422e-818d-e35655cc8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:07.848481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470517e-e505-422e-818d-e35655cc8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:07.848772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470517e-e505-422e-818d-e35655cc8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:07.849038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470517e-e505-422e-818d-e35655cc8cb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:07.860039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470517e-e505-422e-818d-e35655cc8cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7470517e-e505-422e-818d-e35655cc8cb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:07.868157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:07.869212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:07.870420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 446/891] 10.222.0.90 () {56 vars in 1120 bytes} [Tue Jun 21 15:01:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:07.878842 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcde132-32ed-4be4-9f6a-3e054234d9f0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:07.929546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb508-7df2-41aa-909a-07ceec864bf3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:07.929546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb508-7df2-41aa-909a-07ceec864bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:07.929546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb508-7df2-41aa-909a-07ceec864bf3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:07.934959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 447/892] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:07.942743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c1acc-e6b2-4220-9e17-a26d3c66a275 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:07.943033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c1acc-e6b2-4220-9e17-a26d3c66a275 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:07.943327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c1acc-e6b2-4220-9e17-a26d3c66a275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:07.971933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c11c1acc-e6b2-4220-9e17-a26d3c66a275 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:07.973459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c11c1acc-e6b2-4220-9e17-a26d3c66a275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:08.009068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcde132-32ed-4be4-9f6a-3e054234d9f0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:08.047828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d8f00-2553-4620-ac2b-3647f5a0b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:08.048557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d8f00-2553-4620-ac2b-3647f5a0b0ff None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:08.048843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d8f00-2553-4620-ac2b-3647f5a0b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:08.049118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d8f00-2553-4620-ac2b-3647f5a0b0ff None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:08.049907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d8f00-2553-4620-ac2b-3647f5a0b0ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:08.050308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d8f00-2553-4620-ac2b-3647f5a0b0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:08.051670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d8f00-2553-4620-ac2b-3647f5a0b0ff None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:08.062541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 446/893] 10.222.0.90 () {56 vars in 1115 bytes} [Tue Jun 21 15:01:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:08.067036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 448/894] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:08.070690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d8f00-2553-4620-ac2b-3647f5a0b0ff None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:08.090656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c1acc-e6b2-4220-9e17-a26d3c66a275 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:08.094890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:08.191063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d8f00-2553-4620-ac2b-3647f5a0b0ff None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:08.210352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c1acc-e6b2-4220-9e17-a26d3c66a275 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:08.228019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67ea78-9a65-4491-86c3-7d69a77a2c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:08.228810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67ea78-9a65-4491-86c3-7d69a77a2c0d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:08.230017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:08.230427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67ea78-9a65-4491-86c3-7d69a77a2c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:08.230857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67ea78-9a65-4491-86c3-7d69a77a2c0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:08.244023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67ea78-9a65-4491-86c3-7d69a77a2c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:08.246311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67ea78-9a65-4491-86c3-7d69a77a2c0d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:08.258694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b0915-4208-4833-b67d-1587ebf3e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:08.259626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b0915-4208-4833-b67d-1587ebf3e77f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:08.260008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b0915-4208-4833-b67d-1587ebf3e77f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:08.260418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b0915-4208-4833-b67d-1587ebf3e77f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:08.261299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b0915-4208-4833-b67d-1587ebf3e77f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:08.262913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b0915-4208-4833-b67d-1587ebf3e77f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4a67ea78-9a65-4491-86c3-7d69a77a2c0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:08.267721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:08.268703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:08.269625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:08.269625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:08.269625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:08.269625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:08.271885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 447/895] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:08.278119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67ea78-9a65-4491-86c3-7d69a77a2c0d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9b4b0915-4208-4833-b67d-1587ebf3e77f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:08.279813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:08.280825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:08.281750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 449/896] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:01:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:08.289212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b0915-4208-4833-b67d-1587ebf3e77f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:08.361487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:08.403744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67ea78-9a65-4491-86c3-7d69a77a2c0d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:08.442495 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121720-7cc0-4a45-83fd-b73b91307292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:08.443598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121720-7cc0-4a45-83fd-b73b91307292 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:08.444147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121720-7cc0-4a45-83fd-b73b91307292 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:08.444642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121720-7cc0-4a45-83fd-b73b91307292 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:08.445778 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46121720-7cc0-4a45-83fd-b73b91307292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:08.446321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46121720-7cc0-4a45-83fd-b73b91307292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:08.448571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46121720-7cc0-4a45-83fd-b73b91307292 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:08.457729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b0915-4208-4833-b67d-1587ebf3e77f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:08.468626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 448/897] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:08.469904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121720-7cc0-4a45-83fd-b73b91307292 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:08.520221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f91dbd-4db5-4b40-b9fc-2cadbe0a50c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:08.521320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f91dbd-4db5-4b40-b9fc-2cadbe0a50c8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:08.521817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f91dbd-4db5-4b40-b9fc-2cadbe0a50c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:08.522712 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f91dbd-4db5-4b40-b9fc-2cadbe0a50c8 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:08.524371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f91dbd-4db5-4b40-b9fc-2cadbe0a50c8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:08.524953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f91dbd-4db5-4b40-b9fc-2cadbe0a50c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:08.529214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f91dbd-4db5-4b40-b9fc-2cadbe0a50c8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:08.541528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 450/898] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:01:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:08.548949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f91dbd-4db5-4b40-b9fc-2cadbe0a50c8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:08.598123 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121720-7cc0-4a45-83fd-b73b91307292 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:08.628572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:08.673345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:08.693915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e03a37-9d7a-42b3-bb02-4f720ce5cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:08.696419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e03a37-9d7a-42b3-bb02-4f720ce5cd86 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:08.697294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e03a37-9d7a-42b3-bb02-4f720ce5cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:08.698710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e03a37-9d7a-42b3-bb02-4f720ce5cd86 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:08.703598 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f91dbd-4db5-4b40-b9fc-2cadbe0a50c8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:08.714815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e03a37-9d7a-42b3-bb02-4f720ce5cd86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:08.717980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e03a37-9d7a-42b3-bb02-4f720ce5cd86 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:08.746463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd8e8b-0b9c-410c-a64b-2b494616f9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:08.747147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd8e8b-0b9c-410c-a64b-2b494616f9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:08.747436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd8e8b-0b9c-410c-a64b-2b494616f9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:08.747728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd8e8b-0b9c-410c-a64b-2b494616f9d2 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:08.748461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd8e8b-0b9c-410c-a64b-2b494616f9d2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f7e03a37-9d7a-42b3-bb02-4f720ce5cd86 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:01:08.748737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:08.750447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:01:08.752080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:08.755307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd8e8b-0b9c-410c-a64b-2b494616f9d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:08.755307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd8e8b-0b9c-410c-a64b-2b494616f9d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:08.755815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 449/899] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:01:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:08.756716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c26dd-a2d0-42c4-84ac-2f08635b8215 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:08.757177 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c26dd-a2d0-42c4-84ac-2f08635b8215 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:08.757674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c26dd-a2d0-42c4-84ac-2f08635b8215 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:08.760101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 450/900] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:08.762724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 451/901] 10.222.0.90 () {56 vars in 1114 bytes} [Tue Jun 21 15:01:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:08.768107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c26dd-a2d0-42c4-84ac-2f08635b8215 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:08.768995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7897204-da7f-448b-a2be-137490b52d64 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:08.769591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7897204-da7f-448b-a2be-137490b52d64 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:08.770086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7897204-da7f-448b-a2be-137490b52d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:08.803502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f7897204-da7f-448b-a2be-137490b52d64 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:08.805576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f7897204-da7f-448b-a2be-137490b52d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:08.943083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 452/902] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:08.944051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7897204-da7f-448b-a2be-137490b52d64 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:08.954405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c26dd-a2d0-42c4-84ac-2f08635b8215 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:08.996962 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:09.012923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174f5e0-b1be-41a5-ac5e-cf4095f3804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:09.013812 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f5e0-b1be-41a5-ac5e-cf4095f3804c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:09.014205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f5e0-b1be-41a5-ac5e-cf4095f3804c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:09.014685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174f5e0-b1be-41a5-ac5e-cf4095f3804c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:09.015688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174f5e0-b1be-41a5-ac5e-cf4095f3804c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:09.016124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174f5e0-b1be-41a5-ac5e-cf4095f3804c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:09.017828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174f5e0-b1be-41a5-ac5e-cf4095f3804c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:09.045322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 451/903] 10.222.0.90 () {56 vars in 1149 bytes} [Tue Jun 21 15:01:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:09.053637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dea3f-8ea3-467c-88ec-b68d1d28388b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:09.053637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dea3f-8ea3-467c-88ec-b68d1d28388b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:09.053637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dea3f-8ea3-467c-88ec-b68d1d28388b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:09.053637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 452/904] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:09.053637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dea3f-8ea3-467c-88ec-b68d1d28388b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:09.090729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7897204-da7f-448b-a2be-137490b52d64 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:09.111836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:09.132227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc962-da15-4500-8d86-e7e16b4d8ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:09.133015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc962-da15-4500-8d86-e7e16b4d8ef4 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:09.133406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc962-da15-4500-8d86-e7e16b4d8ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:09.133827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc962-da15-4500-8d86-e7e16b4d8ef4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:09.134676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cc962-da15-4500-8d86-e7e16b4d8ef4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:09.136723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cc962-da15-4500-8d86-e7e16b4d8ef4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:09.172722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 453/905] 10.222.0.90 () {60 vars in 1144 bytes} [Tue Jun 21 15:01:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:09.172722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc962-da15-4500-8d86-e7e16b4d8ef4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:09.189671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dea3f-8ea3-467c-88ec-b68d1d28388b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:09.259031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7089c2-0ce5-432c-8acf-5adf5291f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:09.260235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7089c2-0ce5-432c-8acf-5adf5291f83b None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:09.261048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7089c2-0ce5-432c-8acf-5adf5291f83b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:09.261225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7089c2-0ce5-432c-8acf-5adf5291f83b None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:09.262018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7089c2-0ce5-432c-8acf-5adf5291f83b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:09.263420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7089c2-0ce5-432c-8acf-5adf5291f83b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:09.289519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 453/906] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:01:09 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:09.289519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ab7fa-3301-4d02-8d4f-05ae40d549f0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:09.289519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ab7fa-3301-4d02-8d4f-05ae40d549f0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:09.289519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ab7fa-3301-4d02-8d4f-05ae40d549f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:09.312926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ea0ab7fa-3301-4d02-8d4f-05ae40d549f0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:09.314434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ea0ab7fa-3301-4d02-8d4f-05ae40d549f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:09.342947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:09.369172 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc962-da15-4500-8d86-e7e16b4d8ef4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:09.417576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 454/907] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:09.443764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ab7fa-3301-4d02-8d4f-05ae40d549f0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:09.450611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab2af1-f598-4587-a938-8949842a1867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:09.451809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab2af1-f598-4587-a938-8949842a1867 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:09.452373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab2af1-f598-4587-a938-8949842a1867 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:09.452876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab2af1-f598-4587-a938-8949842a1867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:09.482176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:09.559679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab2af1-f598-4587-a938-8949842a1867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:09.561547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab2af1-f598-4587-a938-8949842a1867 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:09.587399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ab7fa-3301-4d02-8d4f-05ae40d549f0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:09.636811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e880e0-9de1-4845-adbd-d1edc5649057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:09.637954 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e880e0-9de1-4845-adbd-d1edc5649057 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:09.638244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e880e0-9de1-4845-adbd-d1edc5649057 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:09.638523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e880e0-9de1-4845-adbd-d1edc5649057 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:09.639188 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e880e0-9de1-4845-adbd-d1edc5649057 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:09.641241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e880e0-9de1-4845-adbd-d1edc5649057 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a3e880e0-9de1-4845-adbd-d1edc5649057 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:09.657457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:09.658517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:09.659426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 455/908] 10.222.0.90 () {56 vars in 1132 bytes} [Tue Jun 21 15:01:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:09.667020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e880e0-9de1-4845-adbd-d1edc5649057 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:09.681740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:09.698524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 454/909] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:09 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:01:09.703777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab2af1-f598-4587-a938-8949842a1867 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:09.796683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:09.807956 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e880e0-9de1-4845-adbd-d1edc5649057 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:09.841239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab2af1-f598-4587-a938-8949842a1867 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:09.846974 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfb779-fb61-4796-89e5-9a36c0a0b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:09.847759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfb779-fb61-4796-89e5-9a36c0a0b555 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:09.848139 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfb779-fb61-4796-89e5-9a36c0a0b555 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:09.848531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfb779-fb61-4796-89e5-9a36c0a0b555 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:09.849335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfb779-fb61-4796-89e5-9a36c0a0b555 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:09.849760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfb779-fb61-4796-89e5-9a36c0a0b555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:09.851309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfb779-fb61-4796-89e5-9a36c0a0b555 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:09.861503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 456/910] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:09.863460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfb779-fb61-4796-89e5-9a36c0a0b555 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:09.892679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20f91a-56cf-43df-9e56-a8e75bbae554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:09.894171 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20f91a-56cf-43df-9e56-a8e75bbae554 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:09.894802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20f91a-56cf-43df-9e56-a8e75bbae554 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:09.895280 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20f91a-56cf-43df-9e56-a8e75bbae554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:09.909435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20f91a-56cf-43df-9e56-a8e75bbae554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:09.912188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20f91a-56cf-43df-9e56-a8e75bbae554 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-de20f91a-56cf-43df-9e56-a8e75bbae554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:09.941930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:09.942941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:09.944599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:09.944599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:09.944599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:09.944599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:09.944599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 455/911] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:09.949364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20f91a-56cf-43df-9e56-a8e75bbae554 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:10.003638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfb779-fb61-4796-89e5-9a36c0a0b555 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:10.009265 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:10.051643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd9aca-0ab4-415b-b445-b58326fee5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:10.052605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd9aca-0ab4-415b-b445-b58326fee5ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:10.052896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd9aca-0ab4-415b-b445-b58326fee5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:10.053168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd9aca-0ab4-415b-b445-b58326fee5ae None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:10.053925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd9aca-0ab4-415b-b445-b58326fee5ae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:10.054240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd9aca-0ab4-415b-b445-b58326fee5ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:10.055914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd9aca-0ab4-415b-b445-b58326fee5ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:10.064379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 457/912] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:10.069314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd9aca-0ab4-415b-b445-b58326fee5ae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:10.083504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20f91a-56cf-43df-9e56-a8e75bbae554 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:10.098748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:10.135946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0a762-517c-4616-a866-e1d71e773928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:10.137627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0a762-517c-4616-a866-e1d71e773928 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:10.138076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0a762-517c-4616-a866-e1d71e773928 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:10.138509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0a762-517c-4616-a866-e1d71e773928 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:10.139401 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0a762-517c-4616-a866-e1d71e773928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:10.139864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0a762-517c-4616-a866-e1d71e773928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:10.142125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0a762-517c-4616-a866-e1d71e773928 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:10.161082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 456/913] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:10.167515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0a762-517c-4616-a866-e1d71e773928 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:10.202219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd9aca-0ab4-415b-b445-b58326fee5ae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:10.242806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f316e97-d4cb-4683-a641-fce619ec83e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:10.243756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f316e97-d4cb-4683-a641-fce619ec83e6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:10.244191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f316e97-d4cb-4683-a641-fce619ec83e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:10.245137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f316e97-d4cb-4683-a641-fce619ec83e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:10.246293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f316e97-d4cb-4683-a641-fce619ec83e6 None admin] RBAC: Adding query filter params (interface=public, service_id=7e716d601c2844a6b4a79b6479734d43, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:10.246827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f316e97-d4cb-4683-a641-fce619ec83e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:10.248359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f316e97-d4cb-4683-a641-fce619ec83e6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:10.254585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 458/914] 10.222.0.90 () {56 vars in 1251 bytes} [Tue Jun 21 15:01:10 2022] GET /identity/v3/endpoints?service_id=7e716d601c2844a6b4a79b6479734d43&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:10.259730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f316e97-d4cb-4683-a641-fce619ec83e6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:10.302708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0a762-517c-4616-a866-e1d71e773928 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:10.304588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:10.349911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6815459-2ac2-4f6d-9e48-f5ea95078930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:10.350718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6815459-2ac2-4f6d-9e48-f5ea95078930 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:10.351006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6815459-2ac2-4f6d-9e48-f5ea95078930 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:10.351286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6815459-2ac2-4f6d-9e48-f5ea95078930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:10.360814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6815459-2ac2-4f6d-9e48-f5ea95078930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:10.362311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6815459-2ac2-4f6d-9e48-f5ea95078930 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:10.375005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a6815459-2ac2-4f6d-9e48-f5ea95078930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:10.382516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:10.383422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:10.384324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:10.384324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:10.384324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:10.384324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:10.384324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:10.384324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:10.384324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:10.384324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:10.387046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 457/915] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:10.393514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f316e97-d4cb-4683-a641-fce619ec83e6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:10.394696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6815459-2ac2-4f6d-9e48-f5ea95078930 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:10.434312 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fda77-08cb-4750-b074-a42c912e7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:10.435273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fda77-08cb-4750-b074-a42c912e7046 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:10.435713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fda77-08cb-4750-b074-a42c912e7046 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:10.436138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fda77-08cb-4750-b074-a42c912e7046 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:10.436965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fda77-08cb-4750-b074-a42c912e7046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:10.438616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fda77-08cb-4750-b074-a42c912e7046 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:10.445721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 459/916] 10.222.0.90 () {56 vars in 1087 bytes} [Tue Jun 21 15:01:10 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:01:10.509176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6815459-2ac2-4f6d-9e48-f5ea95078930 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:10.555535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6835b-5418-47c1-ad7c-ef2414aed770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:10.556222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6835b-5418-47c1-ad7c-ef2414aed770 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:10.556523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6835b-5418-47c1-ad7c-ef2414aed770 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:10.556799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6835b-5418-47c1-ad7c-ef2414aed770 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:10.558408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6835b-5418-47c1-ad7c-ef2414aed770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:10.558817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6835b-5418-47c1-ad7c-ef2414aed770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:10.561517 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6835b-5418-47c1-ad7c-ef2414aed770 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:10.578929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 458/917] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:10.585379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fda77-08cb-4750-b074-a42c912e7046 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:10.725268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fda77-08cb-4750-b074-a42c912e7046 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:10.777425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f26567-dba9-470b-bccb-0fbe34210667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:10.778062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f26567-dba9-470b-bccb-0fbe34210667 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:10.778351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f26567-dba9-470b-bccb-0fbe34210667 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:10.778678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f26567-dba9-470b-bccb-0fbe34210667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:10.779605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f26567-dba9-470b-bccb-0fbe34210667 None admin] RBAC: Adding query filter params (role.id=4e80c2f6fbb84dad8a1fd3ff04caa94e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=f0564976d31a4fe79742b978c6bee315) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:10.779930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f26567-dba9-470b-bccb-0fbe34210667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:10.781506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f26567-dba9-470b-bccb-0fbe34210667 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:10.788762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 460/918] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:10 2022] GET /identity/v3/role_assignments?user.id=f0564976d31a4fe79742b978c6bee315&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4e80c2f6fbb84dad8a1fd3ff04caa94e => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:11.568978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370894-4152-471a-a17e-6286150ae269 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:11.569525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370894-4152-471a-a17e-6286150ae269 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:11.569608 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370894-4152-471a-a17e-6286150ae269 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:11.571149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 459/919] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:11.577634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f4096-886c-4615-89e3-bf4c85e9a5b2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:11.578088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f4096-886c-4615-89e3-bf4c85e9a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:11.578167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f4096-886c-4615-89e3-bf4c85e9a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:11.596041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-901f4096-886c-4615-89e3-bf4c85e9a5b2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:11.597219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-901f4096-886c-4615-89e3-bf4c85e9a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:11.605308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:11.634730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e409-9de7-40f5-845e-76982d46cca4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:11.635763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e409-9de7-40f5-845e-76982d46cca4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:11.636104 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946e409-9de7-40f5-845e-76982d46cca4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:11.638854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 460/920] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:11.644297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb6c3e-e230-49bc-bc3d-4736e5adf24c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:11.644621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb6c3e-e230-49bc-bc3d-4736e5adf24c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:11.644844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb6c3e-e230-49bc-bc3d-4736e5adf24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:11.663591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e1cb6c3e-e230-49bc-bc3d-4736e5adf24c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:11.664779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e1cb6c3e-e230-49bc-bc3d-4736e5adf24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:11.673952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 461/921] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:11.687300 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:11.703137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f4096-886c-4615-89e3-bf4c85e9a5b2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:11.749005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 461/922] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:11.773900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb6c3e-e230-49bc-bc3d-4736e5adf24c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:11.809811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f4096-886c-4615-89e3-bf4c85e9a5b2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:11.846009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:11.846538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:11.846827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:11.847108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:11.847834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:11.849264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:11.850658 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WARNING keystone.server.flask.common [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 15:01:11.864942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:11.870369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.sql.core [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 15:01:11.870369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 15:01:11.870369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [parameters: {'id': '78e60df88687452187f942faaf028f44', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 15:01:11.870369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 78e60df88687452187f942faaf028f44.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 78e60df88687452187f942faaf028f44. Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:01:11.881722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 21 15:01:11.882695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application yield resource Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise self.value Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application session.commit() Jun 21 15:01:11.883882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.flush() Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application compat.raise_( Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 15:01:11.885111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 15:01:11.886241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:01:11.887039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [parameters: {'id': '78e60df88687452187f942faaf028f44', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:11.887920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:11.888746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 78e60df88687452187f942faaf028f44. Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:11.895520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 462/923] 10.222.0.90 () {60 vars in 1140 bytes} [Tue Jun 21 15:01:11 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:11.896864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb6c3e-e230-49bc-bc3d-4736e5adf24c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:11.897009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:11.941789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917cc9-5738-47f8-9da0-43c2debc8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:11.942603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917cc9-5738-47f8-9da0-43c2debc8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:11.942891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917cc9-5738-47f8-9da0-43c2debc8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:11.943173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917cc9-5738-47f8-9da0-43c2debc8cb6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:11.943943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea917cc9-5738-47f8-9da0-43c2debc8cb6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:11.945296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea917cc9-5738-47f8-9da0-43c2debc8cb6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ea917cc9-5738-47f8-9da0-43c2debc8cb6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:11.963440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:11.964611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:11.965498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:11.970128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 462/924] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:11.971026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917cc9-5738-47f8-9da0-43c2debc8cb6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:11.991567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:12.051762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcde87-26d7-466b-b272-135b9c1ec745 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:12.086454 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917cc9-5738-47f8-9da0-43c2debc8cb6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:12.103370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca17d2-3132-4a3d-8197-b4ae89147020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:12.105423 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca17d2-3132-4a3d-8197-b4ae89147020 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.106356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca17d2-3132-4a3d-8197-b4ae89147020 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.106834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca17d2-3132-4a3d-8197-b4ae89147020 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.117153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca17d2-3132-4a3d-8197-b4ae89147020 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:12.120572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca17d2-3132-4a3d-8197-b4ae89147020 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:12.124909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a2da-f525-418c-bd66-e79ab63a845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:12.125608 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a2da-f525-418c-bd66-e79ab63a845f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.125898 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a2da-f525-418c-bd66-e79ab63a845f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.126188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a2da-f525-418c-bd66-e79ab63a845f None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.126893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8a2da-f525-418c-bd66-e79ab63a845f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:12.127205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8a2da-f525-418c-bd66-e79ab63a845f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:12.128611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8a2da-f525-418c-bd66-e79ab63a845f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:12.138940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 463/925] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-67ca17d2-3132-4a3d-8197-b4ae89147020 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:12.139379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:12.140264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:12.141195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:12.141195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:12.141195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:12.141195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:12.141195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:12.141195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:12.141195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:12.141195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:12.141654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a2da-f525-418c-bd66-e79ab63a845f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:12.147700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 463/926] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:12.148890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca17d2-3132-4a3d-8197-b4ae89147020 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:12.221740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:12.255922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:12.280492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a2da-f525-418c-bd66-e79ab63a845f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:12.284523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca17d2-3132-4a3d-8197-b4ae89147020 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:12.320403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8ea38-f28d-4f57-9ec2-5be429097f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:12.321340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8ea38-f28d-4f57-9ec2-5be429097f4b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.321453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8ea38-f28d-4f57-9ec2-5be429097f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.321782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8ea38-f28d-4f57-9ec2-5be429097f4b None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.323061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8ea38-f28d-4f57-9ec2-5be429097f4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:12.323391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8ea38-f28d-4f57-9ec2-5be429097f4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:12.325093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8ea38-f28d-4f57-9ec2-5be429097f4b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:12.331486 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a442d66-edc8-4cf3-9db5-5d3f43a00df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:12.332439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a442d66-edc8-4cf3-9db5-5d3f43a00df3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.332920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a442d66-edc8-4cf3-9db5-5d3f43a00df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.333413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a442d66-edc8-4cf3-9db5-5d3f43a00df3 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.334390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a442d66-edc8-4cf3-9db5-5d3f43a00df3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:12.334911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a442d66-edc8-4cf3-9db5-5d3f43a00df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:12.335476 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 464/927] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:12.336412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8ea38-f28d-4f57-9ec2-5be429097f4b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:12.337338 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a442d66-edc8-4cf3-9db5-5d3f43a00df3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:12.364659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 464/928] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:01:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:12.459762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8ea38-f28d-4f57-9ec2-5be429097f4b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:12.499722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e109a-fc39-4635-b9b3-dd8f3cc8e7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:12.500762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e109a-fc39-4635-b9b3-dd8f3cc8e7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.501277 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e109a-fc39-4635-b9b3-dd8f3cc8e7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.501776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e109a-fc39-4635-b9b3-dd8f3cc8e7e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.502796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e109a-fc39-4635-b9b3-dd8f3cc8e7e9 None admin] RBAC: Adding query filter params (interface=public, service_id=26cca2de40404dfdb27aa7bbe76a2bdf, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:12.503328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e109a-fc39-4635-b9b3-dd8f3cc8e7e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:12.504934 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e109a-fc39-4635-b9b3-dd8f3cc8e7e9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:12.512976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 465/929] 10.222.0.90 () {56 vars in 1251 bytes} [Tue Jun 21 15:01:12 2022] GET /identity/v3/endpoints?service_id=26cca2de40404dfdb27aa7bbe76a2bdf&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:12.519749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a442d66-edc8-4cf3-9db5-5d3f43a00df3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:12.613320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e653b-d179-446b-8b79-aba05557e43f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.613863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e653b-d179-446b-8b79-aba05557e43f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.613966 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e653b-d179-446b-8b79-aba05557e43f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.615315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 466/930] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:12.621706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa521-07fe-49b9-a60f-b7a30b8a6a3a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.622068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa521-07fe-49b9-a60f-b7a30b8a6a3a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.622417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa521-07fe-49b9-a60f-b7a30b8a6a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.644909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b31aa521-07fe-49b9-a60f-b7a30b8a6a3a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:12.647106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b31aa521-07fe-49b9-a60f-b7a30b8a6a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:12.651155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:12.655483 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a442d66-edc8-4cf3-9db5-5d3f43a00df3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:12.677976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:12.703070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63535d-c3d0-4920-9033-40896835f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:12.704607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63535d-c3d0-4920-9033-40896835f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.704894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63535d-c3d0-4920-9033-40896835f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.705170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63535d-c3d0-4920-9033-40896835f4e5 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.705958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63535d-c3d0-4920-9033-40896835f4e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:12.707340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63535d-c3d0-4920-9033-40896835f4e5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:12.715584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 465/931] 10.222.0.90 () {56 vars in 1087 bytes} [Tue Jun 21 15:01:12 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:01:12.748888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 467/932] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:12.772794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63535d-c3d0-4920-9033-40896835f4e5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:12.892416 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63535d-c3d0-4920-9033-40896835f4e5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:12.923090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cf1ea-c225-409a-a8de-9b2184be97c0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.923397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cf1ea-c225-409a-a8de-9b2184be97c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.923640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cf1ea-c225-409a-a8de-9b2184be97c0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.925272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 468/933] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:12.930987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d83b88-4702-40a0-a527-3ad9037f33b0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.930987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d83b88-4702-40a0-a527-3ad9037f33b0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.931196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d83b88-4702-40a0-a527-3ad9037f33b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.942454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08be3f-cc30-42fa-bfc8-90f8a929bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:12.943278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08be3f-cc30-42fa-bfc8-90f8a929bfdd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:12.943564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08be3f-cc30-42fa-bfc8-90f8a929bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:12.943842 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08be3f-cc30-42fa-bfc8-90f8a929bfdd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:12.944506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08be3f-cc30-42fa-bfc8-90f8a929bfdd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:12.946002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08be3f-cc30-42fa-bfc8-90f8a929bfdd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:12.951902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-14d83b88-4702-40a0-a527-3ad9037f33b0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:12.953394 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-14d83b88-4702-40a0-a527-3ad9037f33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3a08be3f-cc30-42fa-bfc8-90f8a929bfdd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:12.959264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:12.960242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:12.961535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 466/934] 10.222.0.90 () {56 vars in 1132 bytes} [Tue Jun 21 15:01:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:12.966693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08be3f-cc30-42fa-bfc8-90f8a929bfdd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:13.038694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:13.045558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 469/935] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:13.071109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d83b88-4702-40a0-a527-3ad9037f33b0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:13.093139 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08be3f-cc30-42fa-bfc8-90f8a929bfdd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:13.128751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5227b3-ec29-4033-bd3b-cf5e67051fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:13.129846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5227b3-ec29-4033-bd3b-cf5e67051fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:13.130338 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5227b3-ec29-4033-bd3b-cf5e67051fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:13.130819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5227b3-ec29-4033-bd3b-cf5e67051fb4 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:13.131728 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5227b3-ec29-4033-bd3b-cf5e67051fb4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:13.132261 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5227b3-ec29-4033-bd3b-cf5e67051fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:13.133851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5227b3-ec29-4033-bd3b-cf5e67051fb4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:13.144919 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 467/936] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:13.146098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5227b3-ec29-4033-bd3b-cf5e67051fb4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:13.150529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:13.184316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d83b88-4702-40a0-a527-3ad9037f33b0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:13.223329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb7b71-e7d1-4697-8d8b-b62976a58b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:13.224205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb7b71-e7d1-4697-8d8b-b62976a58b20 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:13.224489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb7b71-e7d1-4697-8d8b-b62976a58b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:13.224767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb7b71-e7d1-4697-8d8b-b62976a58b20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:13.241346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb7b71-e7d1-4697-8d8b-b62976a58b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7ffb7b71-e7d1-4697-8d8b-b62976a58b20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:13.251266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:13.252240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:13.254369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 470/937] 10.222.0.90 () {56 vars in 1120 bytes} [Tue Jun 21 15:01:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:13.258258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb7b71-e7d1-4697-8d8b-b62976a58b20 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:13.259794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5227b3-ec29-4033-bd3b-cf5e67051fb4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:13.271090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:13.296509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed855-2a31-406e-9b23-2bf9732da5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:13.297186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed855-2a31-406e-9b23-2bf9732da5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:13.297486 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed855-2a31-406e-9b23-2bf9732da5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:13.297790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ed855-2a31-406e-9b23-2bf9732da5a6 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:13.298493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed855-2a31-406e-9b23-2bf9732da5a6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:13.298810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed855-2a31-406e-9b23-2bf9732da5a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:13.300220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ed855-2a31-406e-9b23-2bf9732da5a6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:13.309843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 468/938] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:13.311901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed855-2a31-406e-9b23-2bf9732da5a6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:13.384588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb7b71-e7d1-4697-8d8b-b62976a58b20 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:13.416390 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:13.420724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ed855-2a31-406e-9b23-2bf9732da5a6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:13.427625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d6f91-119c-4ce8-9f5d-cfcd433f2444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:13.428710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d6f91-119c-4ce8-9f5d-cfcd433f2444 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:13.429238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d6f91-119c-4ce8-9f5d-cfcd433f2444 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:13.429760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d6f91-119c-4ce8-9f5d-cfcd433f2444 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:13.430877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d6f91-119c-4ce8-9f5d-cfcd433f2444 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:13.431446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d6f91-119c-4ce8-9f5d-cfcd433f2444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:13.434094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d6f91-119c-4ce8-9f5d-cfcd433f2444 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:13.449275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 471/939] 10.222.0.90 () {56 vars in 1115 bytes} [Tue Jun 21 15:01:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:13.450767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d6f91-119c-4ce8-9f5d-cfcd433f2444 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:13.458914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696136c8-a670-404d-a977-c3f928b0d940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:13.459580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696136c8-a670-404d-a977-c3f928b0d940 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:13.459866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696136c8-a670-404d-a977-c3f928b0d940 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:13.460146 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696136c8-a670-404d-a977-c3f928b0d940 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:13.460960 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696136c8-a670-404d-a977-c3f928b0d940 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:13.462494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696136c8-a670-404d-a977-c3f928b0d940 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:13.493622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 469/940] 10.222.0.90 () {60 vars in 1144 bytes} [Tue Jun 21 15:01:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:01:13.580333 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d6f91-119c-4ce8-9f5d-cfcd433f2444 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:13.628315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192461f-aea5-47aa-93f8-328c388eca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:13.629989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192461f-aea5-47aa-93f8-328c388eca27 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:13.630486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192461f-aea5-47aa-93f8-328c388eca27 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:13.630968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192461f-aea5-47aa-93f8-328c388eca27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:13.644870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192461f-aea5-47aa-93f8-328c388eca27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:13.646759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192461f-aea5-47aa-93f8-328c388eca27 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8192461f-aea5-47aa-93f8-328c388eca27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:13.667770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:13.668876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:13.669882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:13.669882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:13.669882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:13.669882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:13.669882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 472/941] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:13.676566 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696136c8-a670-404d-a977-c3f928b0d940 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:13.715320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:13.795442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696136c8-a670-404d-a977-c3f928b0d940 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:13.832261 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4f519-e7b1-4a40-bd2f-b317e3bc8e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:13.832934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4f519-e7b1-4a40-bd2f-b317e3bc8e9e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:13.833222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4f519-e7b1-4a40-bd2f-b317e3bc8e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:13.833522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4f519-e7b1-4a40-bd2f-b317e3bc8e9e None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:13.834258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4f519-e7b1-4a40-bd2f-b317e3bc8e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:13.834569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4f519-e7b1-4a40-bd2f-b317e3bc8e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:13.835946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4f519-e7b1-4a40-bd2f-b317e3bc8e9e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:13.849664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 470/942] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:13.856423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192461f-aea5-47aa-93f8-328c388eca27 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:13.917260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:13.991365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192461f-aea5-47aa-93f8-328c388eca27 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:14.029446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c219e-9a29-4ce7-850b-2423a04d39aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:14.030374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c219e-9a29-4ce7-850b-2423a04d39aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:14.030666 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c219e-9a29-4ce7-850b-2423a04d39aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:14.030947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c219e-9a29-4ce7-850b-2423a04d39aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:14.038960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c219e-9a29-4ce7-850b-2423a04d39aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:14.040406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c219e-9a29-4ce7-850b-2423a04d39aa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d28c219e-9a29-4ce7-850b-2423a04d39aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:01:14.057455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:14.058482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:14.059504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 473/943] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:01:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:14.065004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4f519-e7b1-4a40-bd2f-b317e3bc8e9e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:14.168803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:14.179123 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4f519-e7b1-4a40-bd2f-b317e3bc8e9e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:14.218681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc196eb2-2b29-4a14-9b74-1b64b8a704cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:14.219413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc196eb2-2b29-4a14-9b74-1b64b8a704cf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:14.219702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc196eb2-2b29-4a14-9b74-1b64b8a704cf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:14.219979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc196eb2-2b29-4a14-9b74-1b64b8a704cf None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:14.220823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc196eb2-2b29-4a14-9b74-1b64b8a704cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:14.221136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc196eb2-2b29-4a14-9b74-1b64b8a704cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:14.222606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc196eb2-2b29-4a14-9b74-1b64b8a704cf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:14.243366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 471/944] 10.222.0.90 () {56 vars in 1149 bytes} [Tue Jun 21 15:01:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:14.252493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c219e-9a29-4ce7-850b-2423a04d39aa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:14.373764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:14.377792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c219e-9a29-4ce7-850b-2423a04d39aa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:14.414501 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ac240-8312-48f8-a6cd-4dfab752f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:14.415304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ac240-8312-48f8-a6cd-4dfab752f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:14.415588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ac240-8312-48f8-a6cd-4dfab752f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:14.415867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ac240-8312-48f8-a6cd-4dfab752f1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:14.428436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ac240-8312-48f8-a6cd-4dfab752f1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:14.429996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ac240-8312-48f8-a6cd-4dfab752f1d3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c37ac240-8312-48f8-a6cd-4dfab752f1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:14.449103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:14.450090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:14.450988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:14.450988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:14.450988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:14.450988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:14.450988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 474/945] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:14.458551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc196eb2-2b29-4a14-9b74-1b64b8a704cf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:14.565984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc196eb2-2b29-4a14-9b74-1b64b8a704cf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:14.603316 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0654d82-0e7f-485b-9cc4-8dbacfd93d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:14.604062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0654d82-0e7f-485b-9cc4-8dbacfd93d18 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:14.604417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0654d82-0e7f-485b-9cc4-8dbacfd93d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:14.604719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0654d82-0e7f-485b-9cc4-8dbacfd93d18 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:14.605445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0654d82-0e7f-485b-9cc4-8dbacfd93d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:14.605779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0654d82-0e7f-485b-9cc4-8dbacfd93d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:14.607259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0654d82-0e7f-485b-9cc4-8dbacfd93d18 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:14.619467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 472/946] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:14.625050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ac240-8312-48f8-a6cd-4dfab752f1d3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:14.663137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1af7a-78e1-42ae-8b20-6d718ef6d723 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:14.663461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1af7a-78e1-42ae-8b20-6d718ef6d723 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:14.663701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1af7a-78e1-42ae-8b20-6d718ef6d723 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:14.665325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 473/947] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:14.671847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e261c-d78b-43e4-b103-ee67f9d5e3a3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:14.672121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e261c-d78b-43e4-b103-ee67f9d5e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:14.672401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e261c-d78b-43e4-b103-ee67f9d5e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:14.690016 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f83e261c-d78b-43e4-b103-ee67f9d5e3a3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:14.691730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f83e261c-d78b-43e4-b103-ee67f9d5e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:14.702299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:14.760782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ac240-8312-48f8-a6cd-4dfab752f1d3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:14.793615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 474/948] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:14.800069 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9311a8-c1b5-4eca-b99e-409a44e9a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:14.800940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9311a8-c1b5-4eca-b99e-409a44e9a780 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:14.801280 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9311a8-c1b5-4eca-b99e-409a44e9a780 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:14.801619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9311a8-c1b5-4eca-b99e-409a44e9a780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:14.809678 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9311a8-c1b5-4eca-b99e-409a44e9a780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:14.811239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9311a8-c1b5-4eca-b99e-409a44e9a780 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:14.814325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e261c-d78b-43e4-b103-ee67f9d5e3a3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ac9311a8-c1b5-4eca-b99e-409a44e9a780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:14.827117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:14.828038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:14.829368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:14.829368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:14.829368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:14.829368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:14.829368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:14.829368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:14.829368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:14.829368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:14.829368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 475/949] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:14.834282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9311a8-c1b5-4eca-b99e-409a44e9a780 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:14.848840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:14.931927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e261c-d78b-43e4-b103-ee67f9d5e3a3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:14.949198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9311a8-c1b5-4eca-b99e-409a44e9a780 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:14.970412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:14.971328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:14.971764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:14.972216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:14.973647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:14.975752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:14.989962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:14.990187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1fb5b-e137-49be-a1dd-b3a553ca7344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:14.991771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1fb5b-e137-49be-a1dd-b3a553ca7344 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:14.992117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1fb5b-e137-49be-a1dd-b3a553ca7344 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:14.992499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1fb5b-e137-49be-a1dd-b3a553ca7344 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:14.994151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1fb5b-e137-49be-a1dd-b3a553ca7344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:14.994536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1fb5b-e137-49be-a1dd-b3a553ca7344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:14.994949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.sql.core [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 15:01:14.994949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 15:01:14.994949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [parameters: {'user_id': 'f52af85d09324d42a5325f309916bd75', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 15:01:14.994949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 15:01:14.996481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1fb5b-e137-49be-a1dd-b3a553ca7344 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jun 21 15:01:15.006879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:01:15.008092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application yield resource Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise self.value Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application session.commit() Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 15:01:15.009151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.flush() Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application compat.raise_( Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 15:01:15.011403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 15:01:15.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 15:01:15.014550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f52af85d09324d42a5325f309916bd75', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:15.016591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 21 15:01:15.018602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 21 15:01:15.021344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 21 15:01:15.021344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 21 15:01:15.021344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 15:01:15.021344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 15:01:15.021344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 15:01:15.021344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:15.021344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 475/950] 10.222.0.90 () {60 vars in 1131 bytes} [Tue Jun 21 15:01:14 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:15.022718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 476/951] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:15.022866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:15.023764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1fb5b-e137-49be-a1dd-b3a553ca7344 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:15.100850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:15.135715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1fb5b-e137-49be-a1dd-b3a553ca7344 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:15.136278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122d8ec-01b4-4064-b4c6-dccfa0a6c440 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:15.177014 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc671f4-73e9-40f2-8f95-f4597c1df2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:15.177864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc671f4-73e9-40f2-8f95-f4597c1df2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.178148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc671f4-73e9-40f2-8f95-f4597c1df2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.178428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc671f4-73e9-40f2-8f95-f4597c1df2b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.178742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49f89b-92a1-4e4f-9050-7730ebba720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:15.179622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49f89b-92a1-4e4f-9050-7730ebba720b None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.179904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49f89b-92a1-4e4f-9050-7730ebba720b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.180234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49f89b-92a1-4e4f-9050-7730ebba720b None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/f0564976d31a4fe79742b978c6bee315/roles/4e80c2f6fbb84dad8a1fd3ff04caa94e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.183551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49f89b-92a1-4e4f-9050-7730ebba720b None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=f0564976d31a4fe79742b978c6bee315, role_id=4e80c2f6fbb84dad8a1fd3ff04caa94e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:15.185085 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49f89b-92a1-4e4f-9050-7730ebba720b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:15.187933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc671f4-73e9-40f2-8f95-f4597c1df2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:15.189652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc671f4-73e9-40f2-8f95-f4597c1df2b0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:15.205574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 477/952] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:01:15 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/f0564976d31a4fe79742b978c6bee315/roles/4e80c2f6fbb84dad8a1fd3ff04caa94e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:01:15.205574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5560cc-3565-4b4d-95ad-daaa08e19a50 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.205574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5560cc-3565-4b4d-95ad-daaa08e19a50 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.205574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5560cc-3565-4b4d-95ad-daaa08e19a50 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.205574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 478/953] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9bc671f4-73e9-40f2-8f95-f4597c1df2b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:01:15.206037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:15.206944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:15.207994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 476/954] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:01:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:15.213361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5560cc-3565-4b4d-95ad-daaa08e19a50 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:15.216955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e80a6e-1452-42d0-a26b-a88acd4f6b4f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.217307 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e80a6e-1452-42d0-a26b-a88acd4f6b4f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.217581 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e80a6e-1452-42d0-a26b-a88acd4f6b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.237745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-08e80a6e-1452-42d0-a26b-a88acd4f6b4f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:15.239311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-08e80a6e-1452-42d0-a26b-a88acd4f6b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:15.311534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:15.330728 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 477/955] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:15.351109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5560cc-3565-4b4d-95ad-daaa08e19a50 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:15.356817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e80a6e-1452-42d0-a26b-a88acd4f6b4f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:15.391239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:15.399256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f797a-a737-497f-9a69-d283c48357d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:15.400494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f797a-a737-497f-9a69-d283c48357d1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.400873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f797a-a737-497f-9a69-d283c48357d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.401159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f797a-a737-497f-9a69-d283c48357d1 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.402113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f797a-a737-497f-9a69-d283c48357d1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:15.402482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f797a-a737-497f-9a69-d283c48357d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:15.404245 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f797a-a737-497f-9a69-d283c48357d1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:15.448867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 479/956] 10.222.0.90 () {56 vars in 1101 bytes} [Tue Jun 21 15:01:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:15.482496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e80a6e-1452-42d0-a26b-a88acd4f6b4f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:15.523893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe546-58f5-4a2a-950d-650831517aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:15.525123 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe546-58f5-4a2a-950d-650831517aec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.525763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe546-58f5-4a2a-950d-650831517aec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.526356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe546-58f5-4a2a-950d-650831517aec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.527256 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fe546-58f5-4a2a-950d-650831517aec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:15.528893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fe546-58f5-4a2a-950d-650831517aec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a80fe546-58f5-4a2a-950d-650831517aec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:15.542670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:15.543863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:15.544758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:15.547830 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 478/957] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:15.554902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f797a-a737-497f-9a69-d283c48357d1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:15.683036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f797a-a737-497f-9a69-d283c48357d1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:15.724992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369b408-f535-4cb6-b622-beee9eb5d339 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.725534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369b408-f535-4cb6-b622-beee9eb5d339 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.725636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369b408-f535-4cb6-b622-beee9eb5d339 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.732895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 479/958] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:15.735911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5167a-7cb4-45b5-880e-d4f2451da276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:15.736918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5167a-7cb4-45b5-880e-d4f2451da276 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.737365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5167a-7cb4-45b5-880e-d4f2451da276 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.737866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5167a-7cb4-45b5-880e-d4f2451da276 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.738947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5167a-7cb4-45b5-880e-d4f2451da276 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:15.739425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5167a-7cb4-45b5-880e-d4f2451da276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:15.739530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96f6a-6d81-49c3-892b-081473f10c49 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.739722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96f6a-6d81-49c3-892b-081473f10c49 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec96f6a-6d81-49c3-892b-081473f10c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.741755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5167a-7cb4-45b5-880e-d4f2451da276 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:15.752126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 480/959] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:15.758402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5167a-7cb4-45b5-880e-d4f2451da276 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:15.766942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7ec96f6a-6d81-49c3-892b-081473f10c49 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:15.768157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7ec96f6a-6d81-49c3-892b-081473f10c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:15.824967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:15.825632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:15.849670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 480/960] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:15.870939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96f6a-6d81-49c3-892b-081473f10c49 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:15.887553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5167a-7cb4-45b5-880e-d4f2451da276 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:15.931015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adecfe-3f12-453a-863c-1f77cfe7c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:15.931719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adecfe-3f12-453a-863c-1f77cfe7c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:15.932015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adecfe-3f12-453a-863c-1f77cfe7c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:15.932339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adecfe-3f12-453a-863c-1f77cfe7c3c6 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:15.933003 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adecfe-3f12-453a-863c-1f77cfe7c3c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:15.933359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adecfe-3f12-453a-863c-1f77cfe7c3c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:15.934930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adecfe-3f12-453a-863c-1f77cfe7c3c6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:15.941696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 481/961] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:15.948069 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adecfe-3f12-453a-863c-1f77cfe7c3c6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:15.995696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec96f6a-6d81-49c3-892b-081473f10c49 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:16.036550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d5268-db7e-4509-b26f-065744b7f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:16.037347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5268-db7e-4509-b26f-065744b7f996 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:16.037906 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5268-db7e-4509-b26f-065744b7f996 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:16.038018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5268-db7e-4509-b26f-065744b7f996 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:16.038637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d5268-db7e-4509-b26f-065744b7f996 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:16.040033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d5268-db7e-4509-b26f-065744b7f996 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-104d5268-db7e-4509-b26f-065744b7f996 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:16.053407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:16.054571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:16.055485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 481/962] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:16.060605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d5268-db7e-4509-b26f-065744b7f996 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:16.070976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adecfe-3f12-453a-863c-1f77cfe7c3c6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:16.094134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:16.120000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:16.129835 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e17e3-ece2-4934-9069-ab941167df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:16.130218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e17e3-ece2-4934-9069-ab941167df87 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:16.130489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e17e3-ece2-4934-9069-ab941167df87 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:16.130784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e17e3-ece2-4934-9069-ab941167df87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:16.131625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e17e3-ece2-4934-9069-ab941167df87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:16.132858 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e17e3-ece2-4934-9069-ab941167df87 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:16.167378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 482/963] 10.222.0.90 () {60 vars in 1144 bytes} [Tue Jun 21 15:01:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:16.203888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d5268-db7e-4509-b26f-065744b7f996 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:16.262782 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f708ad6-dfe7-4bdf-b9e5-b9f9e59e78a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:16.263539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f708ad6-dfe7-4bdf-b9e5-b9f9e59e78a9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:16.263825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f708ad6-dfe7-4bdf-b9e5-b9f9e59e78a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:16.264172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f708ad6-dfe7-4bdf-b9e5-b9f9e59e78a9 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:16.264911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f708ad6-dfe7-4bdf-b9e5-b9f9e59e78a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:16.265222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f708ad6-dfe7-4bdf-b9e5-b9f9e59e78a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:16.266663 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f708ad6-dfe7-4bdf-b9e5-b9f9e59e78a9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:16.277647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 482/964] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:01:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:16.279448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e17e3-ece2-4934-9069-ab941167df87 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:16.402731 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e17e3-ece2-4934-9069-ab941167df87 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:16.445166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e36a97-c962-4af8-a3e4-a4883371295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:16.445882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e36a97-c962-4af8-a3e4-a4883371295e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:16.446170 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e36a97-c962-4af8-a3e4-a4883371295e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:16.446439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e36a97-c962-4af8-a3e4-a4883371295e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:16.447285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e36a97-c962-4af8-a3e4-a4883371295e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:16.447738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e36a97-c962-4af8-a3e4-a4883371295e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:16.449588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e36a97-c962-4af8-a3e4-a4883371295e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:16.454903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 483/965] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:01:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:17.444379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a6890-743d-4202-bf40-2e26fdb635e4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:17.444933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a6890-743d-4202-bf40-2e26fdb635e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:17.444933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a6890-743d-4202-bf40-2e26fdb635e4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:17.446334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 483/966] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:17.452753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1aa98-1d05-4e82-b7cd-dcafcea36dcd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:17.453213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1aa98-1d05-4e82-b7cd-dcafcea36dcd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:17.453329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1aa98-1d05-4e82-b7cd-dcafcea36dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:17.470883 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-32f1aa98-1d05-4e82-b7cd-dcafcea36dcd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:17.472092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-32f1aa98-1d05-4e82-b7cd-dcafcea36dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:17.504258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:17.553729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 484/967] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:17.579354 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a6890-743d-4202-bf40-2e26fdb635e4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:17.686993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a6890-743d-4202-bf40-2e26fdb635e4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:17.696025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:17.724382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b8dad-659d-4141-ad84-70195b2e6340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:17.725192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b8dad-659d-4141-ad84-70195b2e6340 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:17.725491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b8dad-659d-4141-ad84-70195b2e6340 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:17.725776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b8dad-659d-4141-ad84-70195b2e6340 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:17.737145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b8dad-659d-4141-ad84-70195b2e6340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0a6b8dad-659d-4141-ad84-70195b2e6340 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:17.745731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:17.746693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:17.747558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:17.749063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 484/968] 10.222.0.90 () {56 vars in 1120 bytes} [Tue Jun 21 15:01:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:17.752723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1aa98-1d05-4e82-b7cd-dcafcea36dcd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:17.861891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1aa98-1d05-4e82-b7cd-dcafcea36dcd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:17.911699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5f9d-0bff-418a-8421-2184d45da495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:17.912379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5f9d-0bff-418a-8421-2184d45da495 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:17.912666 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5f9d-0bff-418a-8421-2184d45da495 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:17.912951 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5f9d-0bff-418a-8421-2184d45da495 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:17.913731 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c5f9d-0bff-418a-8421-2184d45da495 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:17.914046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c5f9d-0bff-418a-8421-2184d45da495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:17.915409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c5f9d-0bff-418a-8421-2184d45da495 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:17.933713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b8dad-659d-4141-ad84-70195b2e6340 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:17.934826 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 485/969] 10.222.0.90 () {56 vars in 1115 bytes} [Tue Jun 21 15:01:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:18.038410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b8dad-659d-4141-ad84-70195b2e6340 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:18.075652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870fe5-d709-4e1a-b9dc-7c2b47263ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:18.076968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870fe5-d709-4e1a-b9dc-7c2b47263ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.077406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870fe5-d709-4e1a-b9dc-7c2b47263ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.077901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870fe5-d709-4e1a-b9dc-7c2b47263ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.089461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04870fe5-d709-4e1a-b9dc-7c2b47263ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:18.090948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04870fe5-d709-4e1a-b9dc-7c2b47263ea5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-04870fe5-d709-4e1a-b9dc-7c2b47263ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:18.109339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:18.110448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:18.111377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:18.111377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:18.111377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:18.111377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:18.112264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 485/970] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:18.116209 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5f9d-0bff-418a-8421-2184d45da495 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:18.146380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:18.224610 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5f9d-0bff-418a-8421-2184d45da495 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:18.259719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddde8e9-ce62-4144-b1cf-61e62522f0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:18.260969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddde8e9-ce62-4144-b1cf-61e62522f0aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.261232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddde8e9-ce62-4144-b1cf-61e62522f0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.261529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddde8e9-ce62-4144-b1cf-61e62522f0aa None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.262255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddde8e9-ce62-4144-b1cf-61e62522f0aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:18.262561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddde8e9-ce62-4144-b1cf-61e62522f0aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:18.263934 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddde8e9-ce62-4144-b1cf-61e62522f0aa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:18.277539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 486/971] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:18.282888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870fe5-d709-4e1a-b9dc-7c2b47263ea5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:18.306113 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:18.337237 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94a1c-08c4-43b8-b0e3-3b534ed8ae7a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.337685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94a1c-08c4-43b8-b0e3-3b534ed8ae7a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.337985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94a1c-08c4-43b8-b0e3-3b534ed8ae7a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.340591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 487/972] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:18.345618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809579c3-05d3-4963-8449-4378d73d5fdd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.345912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809579c3-05d3-4963-8449-4378d73d5fdd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.346186 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809579c3-05d3-4963-8449-4378d73d5fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.364791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-809579c3-05d3-4963-8449-4378d73d5fdd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:18.366002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-809579c3-05d3-4963-8449-4378d73d5fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:18.397207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870fe5-d709-4e1a-b9dc-7c2b47263ea5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:18.438845 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 488/973] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:18.443375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283beb9-6e5d-4d7b-8ebd-0580da067f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:18.444191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283beb9-6e5d-4d7b-8ebd-0580da067f95 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.444471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283beb9-6e5d-4d7b-8ebd-0580da067f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.444996 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283beb9-6e5d-4d7b-8ebd-0580da067f95 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.454063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283beb9-6e5d-4d7b-8ebd-0580da067f95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:18.455497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283beb9-6e5d-4d7b-8ebd-0580da067f95 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:18.461551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809579c3-05d3-4963-8449-4378d73d5fdd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a283beb9-6e5d-4d7b-8ebd-0580da067f95 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:01:18.474344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:18.475380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 15:01:18.476432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:18.477221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 486/974] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:01:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:18.483243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283beb9-6e5d-4d7b-8ebd-0580da067f95 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:18.487321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:18.580540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809579c3-05d3-4963-8449-4378d73d5fdd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:18.580729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:18.606899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283beb9-6e5d-4d7b-8ebd-0580da067f95 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:18.618880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ae976-4b20-4e10-9f0c-88d291d9ea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:18.619875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae976-4b20-4e10-9f0c-88d291d9ea0f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.620111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae976-4b20-4e10-9f0c-88d291d9ea0f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.620391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae976-4b20-4e10-9f0c-88d291d9ea0f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.621051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ae976-4b20-4e10-9f0c-88d291d9ea0f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:18.622456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ae976-4b20-4e10-9f0c-88d291d9ea0f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-295ae976-4b20-4e10-9f0c-88d291d9ea0f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:18.634544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:18.636166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:18.637050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 489/975] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:18.637919 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a319-4f43-460e-8d3d-5f3f597fb234 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.637919 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a319-4f43-460e-8d3d-5f3f597fb234 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.637919 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a319-4f43-460e-8d3d-5f3f597fb234 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.639149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 490/976] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:18.642455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a319-4f43-460e-8d3d-5f3f597fb234 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:18.644000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661f3a5-d0a1-4ac6-9359-e8c777b24a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:18.644668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661f3a5-d0a1-4ac6-9359-e8c777b24a82 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.644984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661f3a5-d0a1-4ac6-9359-e8c777b24a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.645267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661f3a5-d0a1-4ac6-9359-e8c777b24a82 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.646139 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661f3a5-d0a1-4ac6-9359-e8c777b24a82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:18.646541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661f3a5-d0a1-4ac6-9359-e8c777b24a82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:18.647963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661f3a5-d0a1-4ac6-9359-e8c777b24a82 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:18.667537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 487/977] 10.222.0.90 () {56 vars in 1149 bytes} [Tue Jun 21 15:01:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:18.669053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113d708-dbeb-469e-997e-8cd8c1023c0e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.669342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113d708-dbeb-469e-997e-8cd8c1023c0e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.669650 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113d708-dbeb-469e-997e-8cd8c1023c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.685825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b113d708-dbeb-469e-997e-8cd8c1023c0e None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:18.686999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b113d708-dbeb-469e-997e-8cd8c1023c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:18.730707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:18.750409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a319-4f43-460e-8d3d-5f3f597fb234 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:18.758691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 488/978] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:18.759705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113d708-dbeb-469e-997e-8cd8c1023c0e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:18.786841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44fcb4-0813-4623-b2d1-28bae5bc3642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:18.787610 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44fcb4-0813-4623-b2d1-28bae5bc3642 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.787894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44fcb4-0813-4623-b2d1-28bae5bc3642 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.788168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44fcb4-0813-4623-b2d1-28bae5bc3642 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.788869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44fcb4-0813-4623-b2d1-28bae5bc3642 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:18.789174 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44fcb4-0813-4623-b2d1-28bae5bc3642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:18.790572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44fcb4-0813-4623-b2d1-28bae5bc3642 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:18.802911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 491/979] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:18.803707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44fcb4-0813-4623-b2d1-28bae5bc3642 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:18.835349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:18.869129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113d708-dbeb-469e-997e-8cd8c1023c0e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:18.904265 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad588a6-aa65-4e71-9f84-90bbb0993347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:18.904932 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad588a6-aa65-4e71-9f84-90bbb0993347 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.905221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad588a6-aa65-4e71-9f84-90bbb0993347 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.905534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad588a6-aa65-4e71-9f84-90bbb0993347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.911185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44fcb4-0813-4623-b2d1-28bae5bc3642 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:18.956766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835924f1-a9b0-4634-b63e-fa00a40b2b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:18.957433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835924f1-a9b0-4634-b63e-fa00a40b2b6c None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:18.957747 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835924f1-a9b0-4634-b63e-fa00a40b2b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:18.958025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835924f1-a9b0-4634-b63e-fa00a40b2b6c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:18.958753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835924f1-a9b0-4634-b63e-fa00a40b2b6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:18.960105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835924f1-a9b0-4634-b63e-fa00a40b2b6c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:18.974958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 492/980] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:01:18 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:18.976029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835924f1-a9b0-4634-b63e-fa00a40b2b6c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:18.984986 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad588a6-aa65-4e71-9f84-90bbb0993347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:18.986550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad588a6-aa65-4e71-9f84-90bbb0993347 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:18.986717 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:19.067355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:19.108953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835924f1-a9b0-4634-b63e-fa00a40b2b6c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:19.111012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 489/981] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:01:19.116595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad588a6-aa65-4e71-9f84-90bbb0993347 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:19.149846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab2c95-5906-4a3e-bd21-cf5a6137f39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:19.151044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab2c95-5906-4a3e-bd21-cf5a6137f39d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:19.151178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab2c95-5906-4a3e-bd21-cf5a6137f39d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:19.151436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab2c95-5906-4a3e-bd21-cf5a6137f39d None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:19.152073 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab2c95-5906-4a3e-bd21-cf5a6137f39d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:19.152387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab2c95-5906-4a3e-bd21-cf5a6137f39d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:19.153807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab2c95-5906-4a3e-bd21-cf5a6137f39d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:19.162259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 493/982] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:19.166906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab2c95-5906-4a3e-bd21-cf5a6137f39d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:19.231889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad588a6-aa65-4e71-9f84-90bbb0993347 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:19.236689 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:19.273896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1374d-4354-46f5-a2ca-034555f87d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:19.274725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1374d-4354-46f5-a2ca-034555f87d7c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:19.275012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1374d-4354-46f5-a2ca-034555f87d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:19.275462 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1374d-4354-46f5-a2ca-034555f87d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:19.283344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab2c95-5906-4a3e-bd21-cf5a6137f39d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:19.287684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1374d-4354-46f5-a2ca-034555f87d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:19.289146 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1374d-4354-46f5-a2ca-034555f87d7c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-36f1374d-4354-46f5-a2ca-034555f87d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:19.309115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:19.310164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:19.311116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:19.311116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:19.311116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:19.311116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:19.311116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 490/983] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:19.315808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1374d-4354-46f5-a2ca-034555f87d7c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:19.324538 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61cd2b-09ac-4f9d-af5d-9a93d65006f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:19.325238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61cd2b-09ac-4f9d-af5d-9a93d65006f9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:19.325531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61cd2b-09ac-4f9d-af5d-9a93d65006f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:19.325941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61cd2b-09ac-4f9d-af5d-9a93d65006f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:19.326753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61cd2b-09ac-4f9d-af5d-9a93d65006f9 None admin] RBAC: Adding query filter params (interface=admin, service_id=26cca2de40404dfdb27aa7bbe76a2bdf, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:19.327068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61cd2b-09ac-4f9d-af5d-9a93d65006f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:19.328457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61cd2b-09ac-4f9d-af5d-9a93d65006f9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:19.339044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 494/984] 10.222.0.90 () {56 vars in 1249 bytes} [Tue Jun 21 15:01:19 2022] GET /identity/v3/endpoints?service_id=26cca2de40404dfdb27aa7bbe76a2bdf&interface=admin®ion_id=RegionOne => generated 193 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:19.340351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61cd2b-09ac-4f9d-af5d-9a93d65006f9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:19.341648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:19.425795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1374d-4354-46f5-a2ca-034555f87d7c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:19.452280 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61cd2b-09ac-4f9d-af5d-9a93d65006f9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:19.462317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d86635-83d6-4896-a99e-495389fa6b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:19.463839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d86635-83d6-4896-a99e-495389fa6b67 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:19.463839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d86635-83d6-4896-a99e-495389fa6b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:19.464262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d86635-83d6-4896-a99e-495389fa6b67 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:19.464998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d86635-83d6-4896-a99e-495389fa6b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:19.465311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d86635-83d6-4896-a99e-495389fa6b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:19.466748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d86635-83d6-4896-a99e-495389fa6b67 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:19.479814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 491/985] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:19.484806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d86635-83d6-4896-a99e-495389fa6b67 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:19.489409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:19.500183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cadc38-cf93-4e32-8de7-c321e18400be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:19.501341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cadc38-cf93-4e32-8de7-c321e18400be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:19.501725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cadc38-cf93-4e32-8de7-c321e18400be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:19.502003 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cadc38-cf93-4e32-8de7-c321e18400be None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:19.502748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cadc38-cf93-4e32-8de7-c321e18400be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:19.504427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cadc38-cf93-4e32-8de7-c321e18400be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:19.511804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 495/986] 10.222.0.90 () {56 vars in 1087 bytes} [Tue Jun 21 15:01:19 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:01:19.591120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:19.614613 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d86635-83d6-4896-a99e-495389fa6b67 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:19.655455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13ac0d-7a70-4dc2-80dc-a1f760032b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:19.656273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13ac0d-7a70-4dc2-80dc-a1f760032b03 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:19.656561 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13ac0d-7a70-4dc2-80dc-a1f760032b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:19.656842 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13ac0d-7a70-4dc2-80dc-a1f760032b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:19.664545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13ac0d-7a70-4dc2-80dc-a1f760032b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:19.667023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13ac0d-7a70-4dc2-80dc-a1f760032b03 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ab13ac0d-7a70-4dc2-80dc-a1f760032b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:19.686505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:19.687689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:19.688901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:19.688901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:19.688901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:19.688901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:19.688901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:19.688901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:19.688901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:19.688901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:19.688901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 492/987] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:19.694896 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cadc38-cf93-4e32-8de7-c321e18400be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:19.811355 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cadc38-cf93-4e32-8de7-c321e18400be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:19.853154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870e77-c244-4d59-9ff8-ac7fe62d445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:19.854418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870e77-c244-4d59-9ff8-ac7fe62d445d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:19.854739 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870e77-c244-4d59-9ff8-ac7fe62d445d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:19.855023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870e77-c244-4d59-9ff8-ac7fe62d445d None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:19.855820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870e77-c244-4d59-9ff8-ac7fe62d445d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:19.856134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870e77-c244-4d59-9ff8-ac7fe62d445d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:19.857709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870e77-c244-4d59-9ff8-ac7fe62d445d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:19.875768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 496/988] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:19.877285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13ac0d-7a70-4dc2-80dc-a1f760032b03 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:19.995786 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13ac0d-7a70-4dc2-80dc-a1f760032b03 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:20.031624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f2928-068c-45db-b4b2-1e0edbb90ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:20.032276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2928-068c-45db-b4b2-1e0edbb90ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:20.032556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2928-068c-45db-b4b2-1e0edbb90ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:20.032832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f2928-068c-45db-b4b2-1e0edbb90ce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:20.033680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2928-068c-45db-b4b2-1e0edbb90ce6 None admin] RBAC: Adding query filter params (role.id=4e80c2f6fbb84dad8a1fd3ff04caa94e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=f0564976d31a4fe79742b978c6bee315) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:20.033997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2928-068c-45db-b4b2-1e0edbb90ce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:20.035409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f2928-068c-45db-b4b2-1e0edbb90ce6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:20.042075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 493/989] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:19 2022] GET /identity/v3/role_assignments?user.id=f0564976d31a4fe79742b978c6bee315&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4e80c2f6fbb84dad8a1fd3ff04caa94e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:21.075359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502ff0e-c356-493d-a577-eb061d579cce None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:21.075873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502ff0e-c356-493d-a577-eb061d579cce None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:21.075987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502ff0e-c356-493d-a577-eb061d579cce None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:21.077418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 497/990] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:21.082445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97a5fe-32fb-4617-a4b3-c755a33b763a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:21.082823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97a5fe-32fb-4617-a4b3-c755a33b763a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:21.083006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97a5fe-32fb-4617-a4b3-c755a33b763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:21.089060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:21.100683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6d97a5fe-32fb-4617-a4b3-c755a33b763a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:21.101899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d97a5fe-32fb-4617-a4b3-c755a33b763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:21.174319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 494/991] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:21.198025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502ff0e-c356-493d-a577-eb061d579cce None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:21.260205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:21.309381 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502ff0e-c356-493d-a577-eb061d579cce None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:21.343674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fee48-40b7-4bc2-9324-4c8c4a64e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:21.344460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fee48-40b7-4bc2-9324-4c8c4a64e542 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:21.344740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fee48-40b7-4bc2-9324-4c8c4a64e542 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:21.345015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fee48-40b7-4bc2-9324-4c8c4a64e542 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:21.345694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fee48-40b7-4bc2-9324-4c8c4a64e542 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:21.347047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fee48-40b7-4bc2-9324-4c8c4a64e542 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4d3fee48-40b7-4bc2-9324-4c8c4a64e542 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:21.359452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:21.360565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:01:21.361965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:21.365623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 498/992] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:21.366956 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97a5fe-32fb-4617-a4b3-c755a33b763a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:21.478033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97a5fe-32fb-4617-a4b3-c755a33b763a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:21.516066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be486f03-c218-412b-b167-e35d296ede7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:21.516807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be486f03-c218-412b-b167-e35d296ede7d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:21.517110 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be486f03-c218-412b-b167-e35d296ede7d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:21.517413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be486f03-c218-412b-b167-e35d296ede7d None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:21.518245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be486f03-c218-412b-b167-e35d296ede7d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:21.518600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be486f03-c218-412b-b167-e35d296ede7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:21.520035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be486f03-c218-412b-b167-e35d296ede7d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:21.521219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:21.531718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 495/993] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:01:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:21.532740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fee48-40b7-4bc2-9324-4c8c4a64e542 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:21.608877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1dd4-4993-4338-b18e-b34512065121 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:21.609226 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1dd4-4993-4338-b18e-b34512065121 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:21.609599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1dd4-4993-4338-b18e-b34512065121 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:21.611031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 496/994] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:21.615956 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57bf6-a845-4606-9088-9ab2e56ec842 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:21.616250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57bf6-a845-4606-9088-9ab2e56ec842 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:21.616532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57bf6-a845-4606-9088-9ab2e56ec842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:21.633973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c2c57bf6-a845-4606-9088-9ab2e56ec842 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:21.636041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c2c57bf6-a845-4606-9088-9ab2e56ec842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:21.647088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fee48-40b7-4bc2-9324-4c8c4a64e542 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:21.666207 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:21.686992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bf1d1-3adb-4502-89d9-731bf0e5a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:21.687768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bf1d1-3adb-4502-89d9-731bf0e5a8bb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:21.687980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bf1d1-3adb-4502-89d9-731bf0e5a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:21.688260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bf1d1-3adb-4502-89d9-731bf0e5a8bb None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:21.688961 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bf1d1-3adb-4502-89d9-731bf0e5a8bb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:21.689280 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bf1d1-3adb-4502-89d9-731bf0e5a8bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:21.690697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bf1d1-3adb-4502-89d9-731bf0e5a8bb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:21.695771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 499/995] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:01:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:21.701499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bf1d1-3adb-4502-89d9-731bf0e5a8bb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:21.712176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 497/996] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:21.739622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57bf6-a845-4606-9088-9ab2e56ec842 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:21.822763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bf1d1-3adb-4502-89d9-731bf0e5a8bb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:21.857822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57bf6-a845-4606-9088-9ab2e56ec842 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:21.860620 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14204-cded-4e05-9d75-110761f381a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:21.861359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14204-cded-4e05-9d75-110761f381a8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:21.861680 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14204-cded-4e05-9d75-110761f381a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:21.861960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14204-cded-4e05-9d75-110761f381a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:21.862746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c14204-cded-4e05-9d75-110761f381a8 None admin] RBAC: Adding query filter params (interface=public, service_id=5b5e85d7f7834f63a3dac1198ca8195f, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:21.863061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c14204-cded-4e05-9d75-110761f381a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:21.864427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c14204-cded-4e05-9d75-110761f381a8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:21.874295 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 500/997] 10.222.0.90 () {56 vars in 1251 bytes} [Tue Jun 21 15:01:21 2022] GET /identity/v3/endpoints?service_id=5b5e85d7f7834f63a3dac1198ca8195f&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:21.875757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14204-cded-4e05-9d75-110761f381a8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:21.894766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:21.904271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db46770-26c3-4d08-95ca-8ea887c8a8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:21.905074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db46770-26c3-4d08-95ca-8ea887c8a8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:21.905358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db46770-26c3-4d08-95ca-8ea887c8a8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:21.905831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db46770-26c3-4d08-95ca-8ea887c8a8f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:21.906476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db46770-26c3-4d08-95ca-8ea887c8a8f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:21.907803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db46770-26c3-4d08-95ca-8ea887c8a8f3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3db46770-26c3-4d08-95ca-8ea887c8a8f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:21.923551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:21.924800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:21.925865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 498/998] 10.222.0.90 () {56 vars in 1126 bytes} [Tue Jun 21 15:01:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:21.931994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db46770-26c3-4d08-95ca-8ea887c8a8f3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:21.938716 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:21.994922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14204-cded-4e05-9d75-110761f381a8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:22.032287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a30ef-1746-49e2-81b9-87cd6146a0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:22.033053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a30ef-1746-49e2-81b9-87cd6146a0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:22.033410 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a30ef-1746-49e2-81b9-87cd6146a0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:22.033739 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a30ef-1746-49e2-81b9-87cd6146a0d8 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:22.034410 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a30ef-1746-49e2-81b9-87cd6146a0d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:22.035794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a30ef-1746-49e2-81b9-87cd6146a0d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:22.042313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db46770-26c3-4d08-95ca-8ea887c8a8f3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:22.043290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 501/999] 10.222.0.90 () {56 vars in 1087 bytes} [Tue Jun 21 15:01:21 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:01:22.081645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec0fa5-a536-4b37-8041-b64dbaa49dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:22.082331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0fa5-a536-4b37-8041-b64dbaa49dff None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:22.082617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0fa5-a536-4b37-8041-b64dbaa49dff None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:22.083233 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0fa5-a536-4b37-8041-b64dbaa49dff None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:22.083615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec0fa5-a536-4b37-8041-b64dbaa49dff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:22.083925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec0fa5-a536-4b37-8041-b64dbaa49dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:22.085325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec0fa5-a536-4b37-8041-b64dbaa49dff None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:22.091955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 499/1000] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:22.097766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a30ef-1746-49e2-81b9-87cd6146a0d8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:22.193138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de750ba3-009d-4638-9685-c67447781998 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:22.193341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de750ba3-009d-4638-9685-c67447781998 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:22.193501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de750ba3-009d-4638-9685-c67447781998 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:22.195028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 500/1001] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:22.201452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9edcc-9257-47ad-9e29-78b4856c8ac9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:22.201776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9edcc-9257-47ad-9e29-78b4856c8ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:22.202067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9edcc-9257-47ad-9e29-78b4856c8ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:22.215367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a30ef-1746-49e2-81b9-87cd6146a0d8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:22.222812 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4ab9edcc-9257-47ad-9e29-78b4856c8ac9 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:22.224000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ab9edcc-9257-47ad-9e29-78b4856c8ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:22.226720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:22.256184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88311d63-46c5-4767-b2bb-f4f47b4c3a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:22.256764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88311d63-46c5-4767-b2bb-f4f47b4c3a80 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:22.257053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88311d63-46c5-4767-b2bb-f4f47b4c3a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:22.257324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88311d63-46c5-4767-b2bb-f4f47b4c3a80 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:22.258078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88311d63-46c5-4767-b2bb-f4f47b4c3a80 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:22.258463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88311d63-46c5-4767-b2bb-f4f47b4c3a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:22.260429 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88311d63-46c5-4767-b2bb-f4f47b4c3a80 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:22.266875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 502/1002] 10.222.0.90 () {56 vars in 1122 bytes} [Tue Jun 21 15:01:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:22.272515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88311d63-46c5-4767-b2bb-f4f47b4c3a80 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:22.282332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:22.301694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 501/1003] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:22.325883 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9edcc-9257-47ad-9e29-78b4856c8ac9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:22.393785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88311d63-46c5-4767-b2bb-f4f47b4c3a80 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:22.433807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698c679-db8c-444f-8fb3-24e6688f7de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:22.434640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698c679-db8c-444f-8fb3-24e6688f7de6 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:22.434924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698c679-db8c-444f-8fb3-24e6688f7de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:22.435187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698c679-db8c-444f-8fb3-24e6688f7de6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:22.435923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698c679-db8c-444f-8fb3-24e6688f7de6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:22.437279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698c679-db8c-444f-8fb3-24e6688f7de6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:22.437561 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9edcc-9257-47ad-9e29-78b4856c8ac9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:22.454860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 503/1004] 10.222.0.90 () {60 vars in 1144 bytes} [Tue Jun 21 15:01:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:01:22.490989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cf5f4-4536-4a1e-8353-c4fe0355d37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:22.491904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cf5f4-4536-4a1e-8353-c4fe0355d37e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:22.492221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cf5f4-4536-4a1e-8353-c4fe0355d37e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:22.492528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cf5f4-4536-4a1e-8353-c4fe0355d37e None admin] PATH_INFO: `/v3/services/image` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:22.493312 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cf5f4-4536-4a1e-8353-c4fe0355d37e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:22.495047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cf5f4-4536-4a1e-8353-c4fe0355d37e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-667cf5f4-4536-4a1e-8353-c4fe0355d37e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:22.508936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:22.510512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:22.511430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 502/1005] 10.222.0.90 () {56 vars in 1105 bytes} [Tue Jun 21 15:01:22 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:22.517524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698c679-db8c-444f-8fb3-24e6688f7de6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:22.576794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:22.653186 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698c679-db8c-444f-8fb3-24e6688f7de6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:22.688790 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482f8a8-4697-44fa-b4f1-ee2be2aae9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:22.689453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f8a8-4697-44fa-b4f1-ee2be2aae9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:22.689810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f8a8-4697-44fa-b4f1-ee2be2aae9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:22.690090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f8a8-4697-44fa-b4f1-ee2be2aae9e0 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:22.690842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482f8a8-4697-44fa-b4f1-ee2be2aae9e0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:22.691158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482f8a8-4697-44fa-b4f1-ee2be2aae9e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:22.692522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482f8a8-4697-44fa-b4f1-ee2be2aae9e0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:22.701376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 504/1006] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:22.704495 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cf5f4-4536-4a1e-8353-c4fe0355d37e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:22.753380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:22.812771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cf5f4-4536-4a1e-8353-c4fe0355d37e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:22.849262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb463c-040d-4ca3-a64e-cd1da82be23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:22.849957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb463c-040d-4ca3-a64e-cd1da82be23a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:22.850260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb463c-040d-4ca3-a64e-cd1da82be23a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:22.850531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb463c-040d-4ca3-a64e-cd1da82be23a None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:22.851250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb463c-040d-4ca3-a64e-cd1da82be23a None admin] RBAC: Adding query filter params (type=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:22.851563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb463c-040d-4ca3-a64e-cd1da82be23a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:22.852937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb463c-040d-4ca3-a64e-cd1da82be23a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:22.858558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 503/1007] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:24.503328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482935a-9e40-4ab8-ad64-6ee8cf5adf39 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:24.503853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482935a-9e40-4ab8-ad64-6ee8cf5adf39 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:24.503933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482935a-9e40-4ab8-ad64-6ee8cf5adf39 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:24.508593 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 505/1008] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:24.511439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2958a2-7ad1-44d5-9b3d-3c19f471ba3d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:24.511858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2958a2-7ad1-44d5-9b3d-3c19f471ba3d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:24.511999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2958a2-7ad1-44d5-9b3d-3c19f471ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:24.529421 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ba2958a2-7ad1-44d5-9b3d-3c19f471ba3d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:24.530649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba2958a2-7ad1-44d5-9b3d-3c19f471ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:24.603473 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 504/1009] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:24.626399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482935a-9e40-4ab8-ad64-6ee8cf5adf39 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:24.779911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:24.786141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482935a-9e40-4ab8-ad64-6ee8cf5adf39 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:24.826492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328fc8-e292-4d60-856c-ada6682e1359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:24.827313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328fc8-e292-4d60-856c-ada6682e1359 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:24.827601 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328fc8-e292-4d60-856c-ada6682e1359 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:24.827879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328fc8-e292-4d60-856c-ada6682e1359 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:24.828566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328fc8-e292-4d60-856c-ada6682e1359 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:24.830083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328fc8-e292-4d60-856c-ada6682e1359 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-31328fc8-e292-4d60-856c-ada6682e1359 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:24.843741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:24.844802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 15:01:24.846097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:24.850746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 506/1010] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:24.851897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2958a2-7ad1-44d5-9b3d-3c19f471ba3d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:24.885749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d2d2f-6ae7-498f-9a0a-a78b796d65f2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:24.886096 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d2d2f-6ae7-498f-9a0a-a78b796d65f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:24.886306 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d2d2f-6ae7-498f-9a0a-a78b796d65f2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:24.887681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 507/1011] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:24.892764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511e802-711a-412d-9287-cfd2d84fc6a5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:24.893055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511e802-711a-412d-9287-cfd2d84fc6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:24.893332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511e802-711a-412d-9287-cfd2d84fc6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:24.904116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:24.911210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9511e802-711a-412d-9287-cfd2d84fc6a5 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:24.912397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9511e802-711a-412d-9287-cfd2d84fc6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:24.982320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2958a2-7ad1-44d5-9b3d-3c19f471ba3d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:24.991171 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 508/1012] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:24.992635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6be2cf-e3f8-4384-b0fc-6300c57ea35a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:24.992969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6be2cf-e3f8-4384-b0fc-6300c57ea35a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:24.993253 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6be2cf-e3f8-4384-b0fc-6300c57ea35a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:24.995107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 509/1013] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:25.003459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41413a-67ad-4d20-bb99-b14b7689e525 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:25.003751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41413a-67ad-4d20-bb99-b14b7689e525 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:25.004033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41413a-67ad-4d20-bb99-b14b7689e525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:25.020632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4534186-181e-4931-b17c-b0c8a07083ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:25.021296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4534186-181e-4931-b17c-b0c8a07083ad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:25.021615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4534186-181e-4931-b17c-b0c8a07083ad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:25.021893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4534186-181e-4931-b17c-b0c8a07083ad None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:25.022123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2f41413a-67ad-4d20-bb99-b14b7689e525 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:25.022604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4534186-181e-4931-b17c-b0c8a07083ad None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:25.022915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4534186-181e-4931-b17c-b0c8a07083ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:25.023322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2f41413a-67ad-4d20-bb99-b14b7689e525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:25.024292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4534186-181e-4931-b17c-b0c8a07083ad None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:25.030289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 505/1014] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:01:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:25.031033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4534186-181e-4931-b17c-b0c8a07083ad None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:25.105427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 510/1015] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:25.106434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41413a-67ad-4d20-bb99-b14b7689e525 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:25.133903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:25.143708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4534186-181e-4931-b17c-b0c8a07083ad None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:25.146089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:25.179729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599e168-e5b3-421b-b204-75a70193740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:25.180543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599e168-e5b3-421b-b204-75a70193740b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:25.180806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599e168-e5b3-421b-b204-75a70193740b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:25.181081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599e168-e5b3-421b-b204-75a70193740b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:25.182433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599e168-e5b3-421b-b204-75a70193740b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:25.183869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599e168-e5b3-421b-b204-75a70193740b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:25.185524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 506/1016] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:25.186259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599e168-e5b3-421b-b204-75a70193740b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:25.214264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41413a-67ad-4d20-bb99-b14b7689e525 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:25.251111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf931767-1992-4388-83ea-b74816aa3e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:25.251778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf931767-1992-4388-83ea-b74816aa3e8f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:25.252063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf931767-1992-4388-83ea-b74816aa3e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:25.252342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf931767-1992-4388-83ea-b74816aa3e8f None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:25.253047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf931767-1992-4388-83ea-b74816aa3e8f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:25.253357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf931767-1992-4388-83ea-b74816aa3e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:25.254758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf931767-1992-4388-83ea-b74816aa3e8f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:25.259598 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 511/1017] 10.222.0.90 () {56 vars in 1112 bytes} [Tue Jun 21 15:01:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:25.261339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf931767-1992-4388-83ea-b74816aa3e8f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:25.289222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599e168-e5b3-421b-b204-75a70193740b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:25.324772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088e648-3226-4a78-8d5c-17a1f819b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:25.325437 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088e648-3226-4a78-8d5c-17a1f819b8af None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:25.325751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088e648-3226-4a78-8d5c-17a1f819b8af None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:25.326028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088e648-3226-4a78-8d5c-17a1f819b8af None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:25.326740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088e648-3226-4a78-8d5c-17a1f819b8af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:25.328108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088e648-3226-4a78-8d5c-17a1f819b8af None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:25.342044 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 507/1018] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:01:25 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:25.342959 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088e648-3226-4a78-8d5c-17a1f819b8af None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:25.350252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:25.370401 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf931767-1992-4388-83ea-b74816aa3e8f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:25.390007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:25.427285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6db3d-721b-48e7-8c1c-4c1bea42ac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:25.427963 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6db3d-721b-48e7-8c1c-4c1bea42ac56 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:25.428251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6db3d-721b-48e7-8c1c-4c1bea42ac56 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:25.428527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6db3d-721b-48e7-8c1c-4c1bea42ac56 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:25.429262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6db3d-721b-48e7-8c1c-4c1bea42ac56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:25.430848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6db3d-721b-48e7-8c1c-4c1bea42ac56 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:25.469500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 512/1019] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:01:25 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:25.480955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088e648-3226-4a78-8d5c-17a1f819b8af None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:25.530218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e08820-1898-4d99-966b-25e6bbda420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:25.530886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08820-1898-4d99-966b-25e6bbda420b None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:25.531226 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08820-1898-4d99-966b-25e6bbda420b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:25.531475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08820-1898-4d99-966b-25e6bbda420b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:25.532275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e08820-1898-4d99-966b-25e6bbda420b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:25.533847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e08820-1898-4d99-966b-25e6bbda420b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:25.555835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 508/1020] 10.222.0.90 () {60 vars in 1144 bytes} [Tue Jun 21 15:01:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:27.590164 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c987ec5-f060-481c-907f-68503a2848d7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:27.590709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c987ec5-f060-481c-907f-68503a2848d7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:27.590709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c987ec5-f060-481c-907f-68503a2848d7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:27.593510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 513/1021] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:27.598356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746258-489b-49be-94b4-8f55a3ada608 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:27.598869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746258-489b-49be-94b4-8f55a3ada608 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:27.598951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746258-489b-49be-94b4-8f55a3ada608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:27.621884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d0746258-489b-49be-94b4-8f55a3ada608 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:27.623077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d0746258-489b-49be-94b4-8f55a3ada608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:27.627789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b74c-747a-4148-8bf1-8713ebb798a1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:27.628081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b74c-747a-4148-8bf1-8713ebb798a1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:27.628363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b74c-747a-4148-8bf1-8713ebb798a1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:27.630008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 514/1022] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:27.636237 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0cbad-ded8-4712-9c9b-06dca0f3fbbc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:27.636739 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0cbad-ded8-4712-9c9b-06dca0f3fbbc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:27.637105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0cbad-ded8-4712-9c9b-06dca0f3fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:27.656719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1aa0cbad-ded8-4712-9c9b-06dca0f3fbbc None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:27.657949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1aa0cbad-ded8-4712-9c9b-06dca0f3fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:27.713633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 509/1023] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:27.734958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0746258-489b-49be-94b4-8f55a3ada608 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:27.737726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 515/1024] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:27.751547 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:27.763508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea55480-2112-4143-b49a-e2dfd02b3885 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:27.764277 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea55480-2112-4143-b49a-e2dfd02b3885 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:27.764277 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea55480-2112-4143-b49a-e2dfd02b3885 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:27.765526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 516/1025] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:27.766219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea55480-2112-4143-b49a-e2dfd02b3885 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:27.833054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:27.843262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0746258-489b-49be-94b4-8f55a3ada608 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:27.874941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea55480-2112-4143-b49a-e2dfd02b3885 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:27.879580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2e00a-8e62-4516-bca8-41022668b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:27.880655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2e00a-8e62-4516-bca8-41022668b9bb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:27.880943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2e00a-8e62-4516-bca8-41022668b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:27.881220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2e00a-8e62-4516-bca8-41022668b9bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:27.882425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2e00a-8e62-4516-bca8-41022668b9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:27.883886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2e00a-8e62-4516-bca8-41022668b9bb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:27.885685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 510/1026] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:27.886859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5b135-21f0-4eb1-80d9-40be2b13be38 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:27.887147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5b135-21f0-4eb1-80d9-40be2b13be38 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:27.887425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5b135-21f0-4eb1-80d9-40be2b13be38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:27.903873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e8a5b135-21f0-4eb1-80d9-40be2b13be38 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:27.905115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e8a5b135-21f0-4eb1-80d9-40be2b13be38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:27.913144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bf566-ca9a-4057-9e7e-48dd38641664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:27.914017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bf566-ca9a-4057-9e7e-48dd38641664 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:27.914297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bf566-ca9a-4057-9e7e-48dd38641664 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:27.914575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bf566-ca9a-4057-9e7e-48dd38641664 None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:27.915326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bf566-ca9a-4057-9e7e-48dd38641664 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:27.917543 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bf566-ca9a-4057-9e7e-48dd38641664 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-542bf566-ca9a-4057-9e7e-48dd38641664 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:27.930819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:27.933095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:27.934330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 517/1027] 10.222.0.90 () {56 vars in 1105 bytes} [Tue Jun 21 15:01:27 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:27.935776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bf566-ca9a-4057-9e7e-48dd38641664 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:27.977977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 511/1028] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:27.979453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5b135-21f0-4eb1-80d9-40be2b13be38 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:27.999111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:28.042993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bf566-ca9a-4057-9e7e-48dd38641664 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:28.070105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:28.079334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47711b-9fe0-4f9b-912a-a9590e97e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:28.080000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47711b-9fe0-4f9b-912a-a9590e97e398 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:28.080286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47711b-9fe0-4f9b-912a-a9590e97e398 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:28.080565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47711b-9fe0-4f9b-912a-a9590e97e398 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:28.081278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47711b-9fe0-4f9b-912a-a9590e97e398 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:28.082784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47711b-9fe0-4f9b-912a-a9590e97e398 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:28.088711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5b135-21f0-4eb1-80d9-40be2b13be38 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:28.111826 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 518/1029] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:01:27 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:28.111826 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47711b-9fe0-4f9b-912a-a9590e97e398 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:28.129110 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae28bb-c057-4ee6-af12-c96ec291e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:28.129825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae28bb-c057-4ee6-af12-c96ec291e042 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:28.130112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae28bb-c057-4ee6-af12-c96ec291e042 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:28.130389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae28bb-c057-4ee6-af12-c96ec291e042 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:28.131127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae28bb-c057-4ee6-af12-c96ec291e042 None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:28.131448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae28bb-c057-4ee6-af12-c96ec291e042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:28.132865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae28bb-c057-4ee6-af12-c96ec291e042 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:28.143892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 512/1030] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:28.144910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae28bb-c057-4ee6-af12-c96ec291e042 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:28.240160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:28.256501 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47711b-9fe0-4f9b-912a-a9590e97e398 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:28.269207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae28bb-c057-4ee6-af12-c96ec291e042 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:28.302589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e93a7-c307-4ed1-a6fd-b65d213c6da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:28.303590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e93a7-c307-4ed1-a6fd-b65d213c6da8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:28.304284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e93a7-c307-4ed1-a6fd-b65d213c6da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:28.304543 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e93a7-c307-4ed1-a6fd-b65d213c6da8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:28.313410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e558afc-a4b5-4cab-a630-7867c6bd2f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:28.314087 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e558afc-a4b5-4cab-a630-7867c6bd2f9c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:28.314410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e558afc-a4b5-4cab-a630-7867c6bd2f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:28.314775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e558afc-a4b5-4cab-a630-7867c6bd2f9c None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:28.315487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e558afc-a4b5-4cab-a630-7867c6bd2f9c None admin] RBAC: Adding query filter params (type=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:28.315797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e558afc-a4b5-4cab-a630-7867c6bd2f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:28.317511 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e558afc-a4b5-4cab-a630-7867c6bd2f9c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:28.320508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e93a7-c307-4ed1-a6fd-b65d213c6da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:28.323488 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 513/1031] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:28.329377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e558afc-a4b5-4cab-a630-7867c6bd2f9c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a58e93a7-c307-4ed1-a6fd-b65d213c6da8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:28.329590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:28.330510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:28.331392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:28.333402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 519/1032] 10.222.0.90 () {56 vars in 1120 bytes} [Tue Jun 21 15:01:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:28.343704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e93a7-c307-4ed1-a6fd-b65d213c6da8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:28.394222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:28.447363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e558afc-a4b5-4cab-a630-7867c6bd2f9c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:28.460435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e93a7-c307-4ed1-a6fd-b65d213c6da8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:28.488425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703d15d-fb91-49a5-b5dc-6539f2c1341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:28.489091 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703d15d-fb91-49a5-b5dc-6539f2c1341b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:28.489376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703d15d-fb91-49a5-b5dc-6539f2c1341b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:28.489691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703d15d-fb91-49a5-b5dc-6539f2c1341b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:28.490488 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703d15d-fb91-49a5-b5dc-6539f2c1341b None admin] RBAC: Adding query filter params (interface=public, service_id=a42e14a092f2414683c51d6e02315393, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:28.490813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703d15d-fb91-49a5-b5dc-6539f2c1341b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:28.492188 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703d15d-fb91-49a5-b5dc-6539f2c1341b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:28.503694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 514/1033] 10.222.0.90 () {56 vars in 1251 bytes} [Tue Jun 21 15:01:28 2022] GET /identity/v3/endpoints?service_id=a42e14a092f2414683c51d6e02315393&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:28.503903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42831c-0297-48a1-934b-1e373e67291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:28.503903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42831c-0297-48a1-934b-1e373e67291b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:28.503903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42831c-0297-48a1-934b-1e373e67291b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:28.503903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42831c-0297-48a1-934b-1e373e67291b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:28.504244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42831c-0297-48a1-934b-1e373e67291b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:28.504244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42831c-0297-48a1-934b-1e373e67291b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:28.504244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42831c-0297-48a1-934b-1e373e67291b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:28.504793 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703d15d-fb91-49a5-b5dc-6539f2c1341b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:28.510683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:28.518544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 520/1034] 10.222.0.90 () {56 vars in 1115 bytes} [Tue Jun 21 15:01:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:28.519735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42831c-0297-48a1-934b-1e373e67291b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:28.626481 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703d15d-fb91-49a5-b5dc-6539f2c1341b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:28.642927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42831c-0297-48a1-934b-1e373e67291b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:28.651425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:28.668284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ebdd0-f978-44c4-99b1-ef9cce9c343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:28.669227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ebdd0-f978-44c4-99b1-ef9cce9c343c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:28.669533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ebdd0-f978-44c4-99b1-ef9cce9c343c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:28.669812 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ebdd0-f978-44c4-99b1-ef9cce9c343c None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:28.670657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ebdd0-f978-44c4-99b1-ef9cce9c343c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:28.672610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ebdd0-f978-44c4-99b1-ef9cce9c343c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:28.681917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 515/1035] 10.222.0.90 () {56 vars in 1087 bytes} [Tue Jun 21 15:01:28 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:01:28.682811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ef66-c92d-49a0-b94c-408d95e8105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:28.683105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ef66-c92d-49a0-b94c-408d95e8105e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:28.683275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ef66-c92d-49a0-b94c-408d95e8105e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:28.683560 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ef66-c92d-49a0-b94c-408d95e8105e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:28.698397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787ef66-c92d-49a0-b94c-408d95e8105e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:28.699361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787ef66-c92d-49a0-b94c-408d95e8105e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2787ef66-c92d-49a0-b94c-408d95e8105e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:28.720728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:28.721863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:28.722795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:28.722795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:28.722795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:28.722795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:28.722795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 521/1036] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:28.730943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ebdd0-f978-44c4-99b1-ef9cce9c343c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:28.813057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:28.854420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ebdd0-f978-44c4-99b1-ef9cce9c343c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:28.895108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c869-f820-42bd-bd2b-f639907d1e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:28.896065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c869-f820-42bd-bd2b-f639907d1e4f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:28.896507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c869-f820-42bd-bd2b-f639907d1e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:28.896949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c869-f820-42bd-bd2b-f639907d1e4f None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:28.897875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c869-f820-42bd-bd2b-f639907d1e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:28.898354 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c869-f820-42bd-bd2b-f639907d1e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:28.899918 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c869-f820-42bd-bd2b-f639907d1e4f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:28.914472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 516/1037] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:28.922145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ef66-c92d-49a0-b94c-408d95e8105e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:29.034847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ef66-c92d-49a0-b94c-408d95e8105e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:29.069818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671360-9a5b-4981-ad37-484c71b19d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:29.070606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671360-9a5b-4981-ad37-484c71b19d37 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:29.070885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671360-9a5b-4981-ad37-484c71b19d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:29.071158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671360-9a5b-4981-ad37-484c71b19d37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:29.079514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52671360-9a5b-4981-ad37-484c71b19d37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:29.080937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52671360-9a5b-4981-ad37-484c71b19d37 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-52671360-9a5b-4981-ad37-484c71b19d37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:01:29.095695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:29.096880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:01:29.098452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:29.101570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 522/1038] 10.222.0.90 () {56 vars in 1093 bytes} [Tue Jun 21 15:01:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:29.102802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c869-f820-42bd-bd2b-f639907d1e4f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:29.216267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c869-f820-42bd-bd2b-f639907d1e4f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:29.248328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:29.257645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b2180-3123-4596-aa64-0a631cb5cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:29.258348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b2180-3123-4596-aa64-0a631cb5cc5b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:29.258697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b2180-3123-4596-aa64-0a631cb5cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:29.259117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b2180-3123-4596-aa64-0a631cb5cc5b None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:29.260420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b2180-3123-4596-aa64-0a631cb5cc5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:29.260746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b2180-3123-4596-aa64-0a631cb5cc5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:29.262238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b2180-3123-4596-aa64-0a631cb5cc5b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:29.288640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 517/1039] 10.222.0.90 () {56 vars in 1133 bytes} [Tue Jun 21 15:01:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:29.290052 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671360-9a5b-4981-ad37-484c71b19d37 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:29.315863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:29.410484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671360-9a5b-4981-ad37-484c71b19d37 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:29.449021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604f27c-cd72-47a5-be7b-8c98cc73d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:29.449731 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604f27c-cd72-47a5-be7b-8c98cc73d83c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:29.450017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604f27c-cd72-47a5-be7b-8c98cc73d83c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:29.450296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604f27c-cd72-47a5-be7b-8c98cc73d83c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:29.523370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604f27c-cd72-47a5-be7b-8c98cc73d83c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:29.524830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604f27c-cd72-47a5-be7b-8c98cc73d83c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:29.544870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:29.638141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 523/1040] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:01:29.640058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b2180-3123-4596-aa64-0a631cb5cc5b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:29.768907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b2180-3123-4596-aa64-0a631cb5cc5b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:29.813009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f313da2-db40-4f20-a9dc-4224ba367741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:29.813958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f313da2-db40-4f20-a9dc-4224ba367741 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:29.814369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f313da2-db40-4f20-a9dc-4224ba367741 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:29.814843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f313da2-db40-4f20-a9dc-4224ba367741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:29.831999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f313da2-db40-4f20-a9dc-4224ba367741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:29.833648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f313da2-db40-4f20-a9dc-4224ba367741 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9f313da2-db40-4f20-a9dc-4224ba367741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:29.855749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:29.856769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:29.858122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:29.858122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:29.858122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:29.858122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:29.861602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 518/1041] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:29.863521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604f27c-cd72-47a5-be7b-8c98cc73d83c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:30.018777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604f27c-cd72-47a5-be7b-8c98cc73d83c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:30.051420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:30.084781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02872-2707-4ffe-804a-b700fe0f2c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:30.085378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02872-2707-4ffe-804a-b700fe0f2c11 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:30.085692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02872-2707-4ffe-804a-b700fe0f2c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:30.085971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02872-2707-4ffe-804a-b700fe0f2c11 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:30.086701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c02872-2707-4ffe-804a-b700fe0f2c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:30.087015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c02872-2707-4ffe-804a-b700fe0f2c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:30.089308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c02872-2707-4ffe-804a-b700fe0f2c11 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:30.103999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 524/1042] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:30.109912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f313da2-db40-4f20-a9dc-4224ba367741 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:30.171030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:30.296742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f313da2-db40-4f20-a9dc-4224ba367741 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:30.344580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af833b-9d06-4a1c-bf75-91ff7efc9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:30.345306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af833b-9d06-4a1c-bf75-91ff7efc9b35 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:30.345651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af833b-9d06-4a1c-bf75-91ff7efc9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:30.345907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af833b-9d06-4a1c-bf75-91ff7efc9b35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:30.355670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af833b-9d06-4a1c-bf75-91ff7efc9b35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:30.357281 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af833b-9d06-4a1c-bf75-91ff7efc9b35 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-18af833b-9d06-4a1c-bf75-91ff7efc9b35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:30.373905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:30.375715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:30.378292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:30.378292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:30.378292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:30.378292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:30.378292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:30.378292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:30.378292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:30.378292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:30.381997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 519/1043] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:30.383847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02872-2707-4ffe-804a-b700fe0f2c11 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:30.405465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30c794-acaf-4d00-9b03-be46f07409f5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:30.405945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30c794-acaf-4d00-9b03-be46f07409f5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:30.407249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30c794-acaf-4d00-9b03-be46f07409f5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:30.409813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 520/1044] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:30.419764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4eadf-0581-4175-8545-43a998e2321f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:30.420223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4eadf-0581-4175-8545-43a998e2321f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:30.420699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4eadf-0581-4175-8545-43a998e2321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:30.453153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-afe4eadf-0581-4175-8545-43a998e2321f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:30.457135 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-afe4eadf-0581-4175-8545-43a998e2321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:30.538575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02872-2707-4ffe-804a-b700fe0f2c11 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:30.559494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 521/1045] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:30.578508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb398-fa18-44a3-a135-7f738f62026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:30.579185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb398-fa18-44a3-a135-7f738f62026b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:30.579469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb398-fa18-44a3-a135-7f738f62026b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:30.579809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffb398-fa18-44a3-a135-7f738f62026b None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:30.580646 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffb398-fa18-44a3-a135-7f738f62026b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:30.580965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffb398-fa18-44a3-a135-7f738f62026b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:30.582442 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffb398-fa18-44a3-a135-7f738f62026b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:30.584729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4eadf-0581-4175-8545-43a998e2321f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:30.597221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 525/1046] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:30.603493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb398-fa18-44a3-a135-7f738f62026b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:30.616826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:30.650573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:30.693925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4eadf-0581-4175-8545-43a998e2321f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:30.720604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffb398-fa18-44a3-a135-7f738f62026b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:30.734617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0ce98-8d1f-4402-a598-5f4d43107a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:30.735466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ce98-8d1f-4402-a598-5f4d43107a6a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:30.735759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ce98-8d1f-4402-a598-5f4d43107a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:30.736040 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0ce98-8d1f-4402-a598-5f4d43107a6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:30.749402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0ce98-8d1f-4402-a598-5f4d43107a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b5d0ce98-8d1f-4402-a598-5f4d43107a6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:30.758605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:30.760769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:30.761965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 522/1047] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:01:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:30.766975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0ce98-8d1f-4402-a598-5f4d43107a6a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:30.779926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2f6be-87d0-41ff-88f6-eeac3526c40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:30.780788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f6be-87d0-41ff-88f6-eeac3526c40b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:30.781140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f6be-87d0-41ff-88f6-eeac3526c40b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:30.781441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2f6be-87d0-41ff-88f6-eeac3526c40b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:30.782449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2f6be-87d0-41ff-88f6-eeac3526c40b None admin] RBAC: Adding query filter params (role.id=4e80c2f6fbb84dad8a1fd3ff04caa94e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=2bd3ffc0a30648139b2cbf19bb6bd535) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:30.782775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2f6be-87d0-41ff-88f6-eeac3526c40b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:30.784422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2f6be-87d0-41ff-88f6-eeac3526c40b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:30.805518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 526/1048] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:30 2022] GET /identity/v3/role_assignments?user.id=2bd3ffc0a30648139b2cbf19bb6bd535&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4e80c2f6fbb84dad8a1fd3ff04caa94e => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:30.935973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:30.946707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0ce98-8d1f-4402-a598-5f4d43107a6a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:31.003139 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f0163-cf47-4705-8314-0eea26a8d324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:31.004148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f0163-cf47-4705-8314-0eea26a8d324 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:31.004148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f0163-cf47-4705-8314-0eea26a8d324 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:31.004148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f0163-cf47-4705-8314-0eea26a8d324 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:31.004813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f0163-cf47-4705-8314-0eea26a8d324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:31.005130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f0163-cf47-4705-8314-0eea26a8d324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:31.006595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f0163-cf47-4705-8314-0eea26a8d324 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:31.018168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 523/1049] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:01:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:31.024400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2f6be-87d0-41ff-88f6-eeac3526c40b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:31.073589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6d06-e3cf-454e-8332-b00ecd50f00b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:31.073877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6d06-e3cf-454e-8332-b00ecd50f00b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:31.074213 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6d06-e3cf-454e-8332-b00ecd50f00b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:31.075756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 524/1050] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:31.081293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248968-01f0-42cd-ae99-0ca14e691f71 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:31.081596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248968-01f0-42cd-ae99-0ca14e691f71 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:31.081929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248968-01f0-42cd-ae99-0ca14e691f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:31.100138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b6248968-01f0-42cd-ae99-0ca14e691f71 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:31.101342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b6248968-01f0-42cd-ae99-0ca14e691f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:31.177391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2f6be-87d0-41ff-88f6-eeac3526c40b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:31.179730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:31.204998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 525/1051] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:31.221539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a514-df33-490d-b3ab-d50da52587d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:31.222449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a514-df33-490d-b3ab-d50da52587d4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:31.222737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a514-df33-490d-b3ab-d50da52587d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:31.223015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a514-df33-490d-b3ab-d50da52587d4 None admin] PATH_INFO: `/v3/users/038a752cec52468988ca3911f54caab0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:31.239080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248968-01f0-42cd-ae99-0ca14e691f71 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:31.247105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5a514-df33-490d-b3ab-d50da52587d4 None admin] RBAC: Authorizing `identity:get_user(user_id=038a752cec52468988ca3911f54caab0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:31.249389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5a514-df33-490d-b3ab-d50da52587d4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:31.257885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 527/1052] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:31 2022] GET /identity/v3/users/038a752cec52468988ca3911f54caab0 => generated 285 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:31.260335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a514-df33-490d-b3ab-d50da52587d4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:31.352548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:31.383840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248968-01f0-42cd-ae99-0ca14e691f71 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:31.423569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a514-df33-490d-b3ab-d50da52587d4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:31.438736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0f6be-0785-4a68-85d5-bacbfb64d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:31.439535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0f6be-0785-4a68-85d5-bacbfb64d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:31.439825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0f6be-0785-4a68-85d5-bacbfb64d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:31.440097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0f6be-0785-4a68-85d5-bacbfb64d1d7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:31.440971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0f6be-0785-4a68-85d5-bacbfb64d1d7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:31.442176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0f6be-0785-4a68-85d5-bacbfb64d1d7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a3b0f6be-0785-4a68-85d5-bacbfb64d1d7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:31.457543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:31.458678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:31.460212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 526/1053] 10.222.0.90 () {56 vars in 1105 bytes} [Tue Jun 21 15:01:31 2022] GET /identity/v3/services/image => generated 86 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:31.467448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0f6be-0785-4a68-85d5-bacbfb64d1d7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:31.485240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5f835-ea2a-4804-811b-d1c437d94682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:31.486009 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5f835-ea2a-4804-811b-d1c437d94682 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:31.486763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5f835-ea2a-4804-811b-d1c437d94682 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:31.486763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5f835-ea2a-4804-811b-d1c437d94682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:31.542437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:31.613296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5f835-ea2a-4804-811b-d1c437d94682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:31.615681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5f835-ea2a-4804-811b-d1c437d94682 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:31.667216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0f6be-0785-4a68-85d5-bacbfb64d1d7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:31.715343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b0202-7944-4fc4-b5f9-8dbc5d7ed104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:31.716307 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b0202-7944-4fc4-b5f9-8dbc5d7ed104 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:31.716307 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b0202-7944-4fc4-b5f9-8dbc5d7ed104 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:31.716579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b0202-7944-4fc4-b5f9-8dbc5d7ed104 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:31.717218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b0202-7944-4fc4-b5f9-8dbc5d7ed104 None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:31.717552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b0202-7944-4fc4-b5f9-8dbc5d7ed104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:31.718928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b0202-7944-4fc4-b5f9-8dbc5d7ed104 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:31.724592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 527/1054] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:31.734818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b0202-7944-4fc4-b5f9-8dbc5d7ed104 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:31.749608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:31.768977 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 528/1055] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:01:31.775682 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5f835-ea2a-4804-811b-d1c437d94682 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:31.860331 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:31.877719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b0202-7944-4fc4-b5f9-8dbc5d7ed104 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:31.914380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5f835-ea2a-4804-811b-d1c437d94682 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:31.922266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08b2ab-8b7f-46ba-a745-7f5e5eb6cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:31.922957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08b2ab-8b7f-46ba-a745-7f5e5eb6cd7d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:31.923248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08b2ab-8b7f-46ba-a745-7f5e5eb6cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:31.923532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08b2ab-8b7f-46ba-a745-7f5e5eb6cd7d None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:31.924254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08b2ab-8b7f-46ba-a745-7f5e5eb6cd7d None admin] RBAC: Adding query filter params (type=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:31.924573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08b2ab-8b7f-46ba-a745-7f5e5eb6cd7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:31.925992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08b2ab-8b7f-46ba-a745-7f5e5eb6cd7d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:31.937034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 528/1056] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:31.945271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08b2ab-8b7f-46ba-a745-7f5e5eb6cd7d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:31.981172 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb381-0afe-42a0-b379-e03786fcb15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:31.982042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb381-0afe-42a0-b379-e03786fcb15e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:31.982331 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb381-0afe-42a0-b379-e03786fcb15e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:31.982613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3eb381-0afe-42a0-b379-e03786fcb15e None admin] PATH_INFO: `/v3/projects/37b1813771f84fada954ef68e60465f0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:31.983823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eb381-0afe-42a0-b379-e03786fcb15e None admin] RBAC: Authorizing `identity:get_project(project_id=37b1813771f84fada954ef68e60465f0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:31.985305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3eb381-0afe-42a0-b379-e03786fcb15e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:31.987136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 529/1057] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:01:31 2022] GET /identity/v3/projects/37b1813771f84fada954ef68e60465f0 => generated 311 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:31.995396 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb381-0afe-42a0-b379-e03786fcb15e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:32.058501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:32.111922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08b2ab-8b7f-46ba-a745-7f5e5eb6cd7d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:32.157746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109831a4-69cd-465f-8cad-137126f8aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:32.158729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109831a4-69cd-465f-8cad-137126f8aa51 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:32.159222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109831a4-69cd-465f-8cad-137126f8aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:32.159472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3eb381-0afe-42a0-b379-e03786fcb15e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:32.160086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109831a4-69cd-465f-8cad-137126f8aa51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:32.160740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109831a4-69cd-465f-8cad-137126f8aa51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:32.163436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109831a4-69cd-465f-8cad-137126f8aa51 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:32.201507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 529/1058] 10.222.0.90 () {60 vars in 1144 bytes} [Tue Jun 21 15:01:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:01:32.205139 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:32.227289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab4795-b462-4da2-9f3f-c549c38e2393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:32.236051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab4795-b462-4da2-9f3f-c549c38e2393 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:32.239297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab4795-b462-4da2-9f3f-c549c38e2393 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:32.239639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab4795-b462-4da2-9f3f-c549c38e2393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:32.240585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab4795-b462-4da2-9f3f-c549c38e2393 None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=37b1813771f84fada954ef68e60465f0, user.id=038a752cec52468988ca3911f54caab0) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:32.240910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab4795-b462-4da2-9f3f-c549c38e2393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:32.242627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab4795-b462-4da2-9f3f-c549c38e2393 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:32.261513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 530/1059] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:31 2022] GET /identity/v3/role_assignments?user.id=038a752cec52468988ca3911f54caab0&scope.project.id=37b1813771f84fada954ef68e60465f0&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:33.282306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a30a-29fc-4fbb-875a-4dfa12ed76b8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:33.282898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a30a-29fc-4fbb-875a-4dfa12ed76b8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:33.282898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83a30a-29fc-4fbb-875a-4dfa12ed76b8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:33.285535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 530/1060] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:33.289707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26a646-af5a-4c1a-a9ff-38b8de21d477 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:33.290273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26a646-af5a-4c1a-a9ff-38b8de21d477 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:33.290273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26a646-af5a-4c1a-a9ff-38b8de21d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:33.309685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0a26a646-af5a-4c1a-a9ff-38b8de21d477 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:33.310931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0a26a646-af5a-4c1a-a9ff-38b8de21d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:33.393680 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 531/1061] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:33.418043 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a30a-29fc-4fbb-875a-4dfa12ed76b8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:33.568325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83a30a-29fc-4fbb-875a-4dfa12ed76b8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:33.600038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:33.613186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966f1d-ec2b-4f2e-8fab-ff0f39e856aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:33.614150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966f1d-ec2b-4f2e-8fab-ff0f39e856aa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:33.614440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966f1d-ec2b-4f2e-8fab-ff0f39e856aa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:33.614727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966f1d-ec2b-4f2e-8fab-ff0f39e856aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:33.631461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48966f1d-ec2b-4f2e-8fab-ff0f39e856aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-48966f1d-ec2b-4f2e-8fab-ff0f39e856aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:33.641420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:33.650539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:33.651914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 531/1062] 10.222.0.90 () {56 vars in 1120 bytes} [Tue Jun 21 15:01:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:33.655950 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26a646-af5a-4c1a-a9ff-38b8de21d477 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:33.793268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26a646-af5a-4c1a-a9ff-38b8de21d477 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:33.820911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:33.845452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212e9f2-a58a-4519-8c8e-27776584df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:33.846402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212e9f2-a58a-4519-8c8e-27776584df75 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:33.846814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212e9f2-a58a-4519-8c8e-27776584df75 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:33.847229 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212e9f2-a58a-4519-8c8e-27776584df75 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:33.848121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212e9f2-a58a-4519-8c8e-27776584df75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:33.848560 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212e9f2-a58a-4519-8c8e-27776584df75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:33.850101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212e9f2-a58a-4519-8c8e-27776584df75 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:33.859947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 532/1063] 10.222.0.90 () {56 vars in 1115 bytes} [Tue Jun 21 15:01:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:33.866080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966f1d-ec2b-4f2e-8fab-ff0f39e856aa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:34.033982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966f1d-ec2b-4f2e-8fab-ff0f39e856aa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:34.083017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e9975-562d-4521-b7fd-1ee31fdaecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:34.083017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e9975-562d-4521-b7fd-1ee31fdaecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.083017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e9975-562d-4521-b7fd-1ee31fdaecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.083565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e9975-562d-4521-b7fd-1ee31fdaecf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.103628 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e9975-562d-4521-b7fd-1ee31fdaecf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:34.105189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e9975-562d-4521-b7fd-1ee31fdaecf9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ee7e9975-562d-4521-b7fd-1ee31fdaecf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:34.126258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:34.134250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:34.135422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:34.135422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:34.135422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:34.135422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:34.135422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 532/1064] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:34.137864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212e9f2-a58a-4519-8c8e-27776584df75 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:34.262288 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212e9f2-a58a-4519-8c8e-27776584df75 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:34.307138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd35993-1bc3-4d29-84ad-4f3c023b8460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:34.307897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd35993-1bc3-4d29-84ad-4f3c023b8460 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.308149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd35993-1bc3-4d29-84ad-4f3c023b8460 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.308383 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd35993-1bc3-4d29-84ad-4f3c023b8460 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.309159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd35993-1bc3-4d29-84ad-4f3c023b8460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:34.309654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd35993-1bc3-4d29-84ad-4f3c023b8460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:34.310918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd35993-1bc3-4d29-84ad-4f3c023b8460 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:34.331892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 533/1065] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:34.332705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e9975-562d-4521-b7fd-1ee31fdaecf9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:34.386290 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:34.488898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e9975-562d-4521-b7fd-1ee31fdaecf9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:34.546071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b18622-05bd-4f96-8bb5-9e56c5a8cf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:34.546952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b18622-05bd-4f96-8bb5-9e56c5a8cf3a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.547231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b18622-05bd-4f96-8bb5-9e56c5a8cf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.547506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b18622-05bd-4f96-8bb5-9e56c5a8cf3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.556846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b18622-05bd-4f96-8bb5-9e56c5a8cf3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:34.558439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b18622-05bd-4f96-8bb5-9e56c5a8cf3a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:34.568861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614fcf9-1080-4958-839b-051885f6c450 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.569133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614fcf9-1080-4958-839b-051885f6c450 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.569533 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614fcf9-1080-4958-839b-051885f6c450 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.571037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 534/1066] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c5b18622-05bd-4f96-8bb5-9e56c5a8cf3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:01:34.578936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:34.580129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:01:34.581487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:34.584131 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2829ee-c74e-4f37-ba67-27ff5d05184c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.584493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2829ee-c74e-4f37-ba67-27ff5d05184c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.584999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 533/1067] 10.222.0.90 () {56 vars in 1093 bytes} [Tue Jun 21 15:01:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:34.585258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2829ee-c74e-4f37-ba67-27ff5d05184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.585823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b18622-05bd-4f96-8bb5-9e56c5a8cf3a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:34.614484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8a2829ee-c74e-4f37-ba67-27ff5d05184c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:34.616008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a2829ee-c74e-4f37-ba67-27ff5d05184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:34.656571 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:34.694768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 535/1068] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:34.697080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03cd4f-df63-43f8-9029-af645d2f4b3a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.697359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03cd4f-df63-43f8-9029-af645d2f4b3a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.697849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03cd4f-df63-43f8-9029-af645d2f4b3a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.699334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 536/1069] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:34.702235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:34.706037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b18622-05bd-4f96-8bb5-9e56c5a8cf3a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:34.706982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084ce98-8388-4241-b515-b43179eb97b3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.707474 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084ce98-8388-4241-b515-b43179eb97b3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.707954 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084ce98-8388-4241-b515-b43179eb97b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.728003 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7084ce98-8388-4241-b515-b43179eb97b3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:34.729274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7084ce98-8388-4241-b515-b43179eb97b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:34.753012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28273b-4082-42ce-8b59-b804ad1aab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:34.753797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28273b-4082-42ce-8b59-b804ad1aab1e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.754083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28273b-4082-42ce-8b59-b804ad1aab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.754356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28273b-4082-42ce-8b59-b804ad1aab1e None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.755204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28273b-4082-42ce-8b59-b804ad1aab1e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:34.755515 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28273b-4082-42ce-8b59-b804ad1aab1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:34.756963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28273b-4082-42ce-8b59-b804ad1aab1e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:34.777299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 534/1070] 10.222.0.90 () {56 vars in 1133 bytes} [Tue Jun 21 15:01:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:34.782664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28273b-4082-42ce-8b59-b804ad1aab1e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:34.825553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 537/1071] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:34.826418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084ce98-8388-4241-b515-b43179eb97b3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:34.942479 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28273b-4082-42ce-8b59-b804ad1aab1e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:34.943785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:34.947777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084ce98-8388-4241-b515-b43179eb97b3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:34.979768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d4270-41aa-4871-8822-9dac740a4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:34.980576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d4270-41aa-4871-8822-9dac740a4f2c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.980861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d4270-41aa-4871-8822-9dac740a4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.981137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d4270-41aa-4871-8822-9dac740a4f2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.988547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99f2a3-21af-4e38-84b6-172ca0399ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:34.989283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99f2a3-21af-4e38-84b6-172ca0399ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:34.989598 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99f2a3-21af-4e38-84b6-172ca0399ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:34.989874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99f2a3-21af-4e38-84b6-172ca0399ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:34.992210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d4270-41aa-4871-8822-9dac740a4f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fc2d4270-41aa-4871-8822-9dac740a4f2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:35.000163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:35.001394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:35.002642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:35.003462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99f2a3-21af-4e38-84b6-172ca0399ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.003605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 535/1072] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:35.003696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99f2a3-21af-4e38-84b6-172ca0399ac0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.003775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d4270-41aa-4871-8822-9dac740a4f2c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3e99f2a3-21af-4e38-84b6-172ca0399ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:35.025808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:35.027234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:35.028376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:35.028376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:35.028376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:35.028376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:35.028657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:35.028811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 538/1073] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:35.029246 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99f2a3-21af-4e38-84b6-172ca0399ac0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.131771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d4270-41aa-4871-8822-9dac740a4f2c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:35.145843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99f2a3-21af-4e38-84b6-172ca0399ac0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:35.173983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a5c09-36db-42f9-bf82-cb882683c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:35.174638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a5c09-36db-42f9-bf82-cb882683c60e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:35.174920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a5c09-36db-42f9-bf82-cb882683c60e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:35.175196 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a5c09-36db-42f9-bf82-cb882683c60e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:35.187624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeeece-5997-43d7-ad67-0308642758ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:35.188159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeeece-5997-43d7-ad67-0308642758ca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:35.188445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeeece-5997-43d7-ad67-0308642758ca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:35.188713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeeece-5997-43d7-ad67-0308642758ca None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:35.189460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeeece-5997-43d7-ad67-0308642758ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:35.189805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeeece-5997-43d7-ad67-0308642758ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.191168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeeece-5997-43d7-ad67-0308642758ca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.201091 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 539/1074] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:35.202426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeeece-5997-43d7-ad67-0308642758ca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.222482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:35.262708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a5c09-36db-42f9-bf82-cb882683c60e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.264167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a5c09-36db-42f9-bf82-cb882683c60e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.289128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:35.315431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeeece-5997-43d7-ad67-0308642758ca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:35.361315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00be17-cdbd-4ea9-a230-fafc5894819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:35.362063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00be17-cdbd-4ea9-a230-fafc5894819d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:35.362556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00be17-cdbd-4ea9-a230-fafc5894819d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:35.362974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00be17-cdbd-4ea9-a230-fafc5894819d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:35.364172 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00be17-cdbd-4ea9-a230-fafc5894819d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:35.364851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00be17-cdbd-4ea9-a230-fafc5894819d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.367096 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00be17-cdbd-4ea9-a230-fafc5894819d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.377708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 536/1075] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:01:35.378575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a5c09-36db-42f9-bf82-cb882683c60e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.386934 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 540/1076] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:35.388367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00be17-cdbd-4ea9-a230-fafc5894819d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.492268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:35.502622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a5c09-36db-42f9-bf82-cb882683c60e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:35.526015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:35.535456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00be17-cdbd-4ea9-a230-fafc5894819d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:35.544835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aadad-e5bb-4973-bcb0-5a5d2b352d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:35.545829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aadad-e5bb-4973-bcb0-5a5d2b352d4b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:35.546111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aadad-e5bb-4973-bcb0-5a5d2b352d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:35.546508 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aadad-e5bb-4973-bcb0-5a5d2b352d4b None admin] PATH_INFO: `/v3/users/038a752cec52468988ca3911f54caab0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:35.547743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20aadad-e5bb-4973-bcb0-5a5d2b352d4b None admin] RBAC: Authorizing `identity:get_user(user_id=038a752cec52468988ca3911f54caab0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.549176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20aadad-e5bb-4973-bcb0-5a5d2b352d4b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.550859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 537/1077] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:35 2022] GET /identity/v3/users/038a752cec52468988ca3911f54caab0 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:35.551626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aadad-e5bb-4973-bcb0-5a5d2b352d4b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.579086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6ef75-b5cc-474c-9d84-1ad6fdec18da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:35.579939 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6ef75-b5cc-474c-9d84-1ad6fdec18da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:35.580246 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6ef75-b5cc-474c-9d84-1ad6fdec18da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:35.580611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6ef75-b5cc-474c-9d84-1ad6fdec18da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:35.592706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6ef75-b5cc-474c-9d84-1ad6fdec18da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.594204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6ef75-b5cc-474c-9d84-1ad6fdec18da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-30f6ef75-b5cc-474c-9d84-1ad6fdec18da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:35.612759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:35.614643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:35.617318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:35.617318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:35.617318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:35.617318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:35.617318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 541/1078] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:35.617318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6ef75-b5cc-474c-9d84-1ad6fdec18da None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.687598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aadad-e5bb-4973-bcb0-5a5d2b352d4b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:35.726275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6ef75-b5cc-474c-9d84-1ad6fdec18da None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:35.729869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe152b4e-80e1-47ab-9252-9357578b814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:35.730669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe152b4e-80e1-47ab-9252-9357578b814a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:35.730955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe152b4e-80e1-47ab-9252-9357578b814a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:35.731241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe152b4e-80e1-47ab-9252-9357578b814a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:35.738729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe152b4e-80e1-47ab-9252-9357578b814a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.740266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe152b4e-80e1-47ab-9252-9357578b814a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fe152b4e-80e1-47ab-9252-9357578b814a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:35.755677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:35.756711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:35.757682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:35.757682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:35.757682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:35.757682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:35.757682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:35.757682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:35.757682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:35.757682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:35.758141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:35.758220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 538/1079] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:35.758220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe152b4e-80e1-47ab-9252-9357578b814a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.767465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ed67a-c8ee-40f0-9276-f8a1e2e50a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:35.768619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ed67a-c8ee-40f0-9276-f8a1e2e50a11 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:35.768910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ed67a-c8ee-40f0-9276-f8a1e2e50a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:35.769192 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ed67a-c8ee-40f0-9276-f8a1e2e50a11 None admin] PATH_INFO: `/v3/projects/37b1813771f84fada954ef68e60465f0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:35.770432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ed67a-c8ee-40f0-9276-f8a1e2e50a11 None admin] RBAC: Authorizing `identity:get_project(project_id=37b1813771f84fada954ef68e60465f0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.771873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ed67a-c8ee-40f0-9276-f8a1e2e50a11 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.773639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 542/1080] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:01:35 2022] GET /identity/v3/projects/37b1813771f84fada954ef68e60465f0 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:35.774417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ed67a-c8ee-40f0-9276-f8a1e2e50a11 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.811798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:35.872127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe152b4e-80e1-47ab-9252-9357578b814a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:35.892760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ed67a-c8ee-40f0-9276-f8a1e2e50a11 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:35.908969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cce369-da51-4821-b1c1-cd3251b39f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:35.909677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cce369-da51-4821-b1c1-cd3251b39f7a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:35.909968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cce369-da51-4821-b1c1-cd3251b39f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:35.910245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cce369-da51-4821-b1c1-cd3251b39f7a None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:35.911045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cce369-da51-4821-b1c1-cd3251b39f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:35.911359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cce369-da51-4821-b1c1-cd3251b39f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.912785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cce369-da51-4821-b1c1-cd3251b39f7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.926818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 539/1081] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:35.927648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cce369-da51-4821-b1c1-cd3251b39f7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:35.945706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93096437-9bdf-4caf-8c4d-61634f9a63a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:35.947143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93096437-9bdf-4caf-8c4d-61634f9a63a8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:35.947418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93096437-9bdf-4caf-8c4d-61634f9a63a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:35.948042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93096437-9bdf-4caf-8c4d-61634f9a63a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:35.948522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93096437-9bdf-4caf-8c4d-61634f9a63a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:35.948837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93096437-9bdf-4caf-8c4d-61634f9a63a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:35.950360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93096437-9bdf-4caf-8c4d-61634f9a63a8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:35.973952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 543/1082] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:35.974915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93096437-9bdf-4caf-8c4d-61634f9a63a8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:36.058256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:36.073904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cce369-da51-4821-b1c1-cd3251b39f7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:36.090986 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:36.130537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6bbe2-672f-4ae0-b09d-62848cf5777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:36.131492 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6bbe2-672f-4ae0-b09d-62848cf5777b None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:36.131770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6bbe2-672f-4ae0-b09d-62848cf5777b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:36.132041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6bbe2-672f-4ae0-b09d-62848cf5777b None admin] PATH_INFO: `/v3/projects/37b1813771f84fada954ef68e60465f0/users/038a752cec52468988ca3911f54caab0/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:36.134935 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6bbe2-672f-4ae0-b09d-62848cf5777b None admin] RBAC: Authorizing `identity:create_grant(project_id=37b1813771f84fada954ef68e60465f0, user_id=038a752cec52468988ca3911f54caab0, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:36.136512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6bbe2-672f-4ae0-b09d-62848cf5777b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:36.146768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93096437-9bdf-4caf-8c4d-61634f9a63a8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:36.153927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 540/1083] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:01:35 2022] PUT /identity/v3/projects/37b1813771f84fada954ef68e60465f0/users/038a752cec52468988ca3911f54caab0/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:01:36.230265 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a19fe-ded0-4c60-ab3d-528c2ff7fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:36.231946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a19fe-ded0-4c60-ab3d-528c2ff7fd89 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:36.232458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a19fe-ded0-4c60-ab3d-528c2ff7fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:36.233068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a19fe-ded0-4c60-ab3d-528c2ff7fd89 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/2bd3ffc0a30648139b2cbf19bb6bd535/roles/4e80c2f6fbb84dad8a1fd3ff04caa94e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:36.237856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a19fe-ded0-4c60-ab3d-528c2ff7fd89 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=2bd3ffc0a30648139b2cbf19bb6bd535, role_id=4e80c2f6fbb84dad8a1fd3ff04caa94e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:36.240489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a19fe-ded0-4c60-ab3d-528c2ff7fd89 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:36.265883 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 544/1084] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:01:35 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/2bd3ffc0a30648139b2cbf19bb6bd535/roles/4e80c2f6fbb84dad8a1fd3ff04caa94e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:01:38.425760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a06c1-b22e-443e-927d-b64fdb1cd61d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:38.426296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a06c1-b22e-443e-927d-b64fdb1cd61d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:38.426413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a06c1-b22e-443e-927d-b64fdb1cd61d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:38.427931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 541/1085] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:38.434299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752c2d1-f3b5-4676-9aa6-312f3838c91d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:38.435616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752c2d1-f3b5-4676-9aa6-312f3838c91d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:38.435616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752c2d1-f3b5-4676-9aa6-312f3838c91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:38.453301 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f752c2d1-f3b5-4676-9aa6-312f3838c91d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:38.454589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f752c2d1-f3b5-4676-9aa6-312f3838c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:38.463800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8046bc-13e5-41d4-9cf6-c4ed47761a85 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:38.464073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8046bc-13e5-41d4-9cf6-c4ed47761a85 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:38.464360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8046bc-13e5-41d4-9cf6-c4ed47761a85 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:38.465790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 542/1086] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:01:38.471110 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c259a6-1f45-421a-9e01-b6f708fb707e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:38.471634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c259a6-1f45-421a-9e01-b6f708fb707e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:38.471925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c259a6-1f45-421a-9e01-b6f708fb707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:38.489680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-89c259a6-1f45-421a-9e01-b6f708fb707e None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:38.490887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89c259a6-1f45-421a-9e01-b6f708fb707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:38.532990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 545/1087] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:38.559551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752c2d1-f3b5-4676-9aa6-312f3838c91d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:38.581712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 543/1088] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:01:38.607368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:38.607638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c259a6-1f45-421a-9e01-b6f708fb707e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:38.675619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752c2d1-f3b5-4676-9aa6-312f3838c91d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:38.717204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d56a-34dd-4ffb-8961-d7e36985a58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:38.718352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d56a-34dd-4ffb-8961-d7e36985a58a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:38.719871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d56a-34dd-4ffb-8961-d7e36985a58a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:38.719871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0d56a-34dd-4ffb-8961-d7e36985a58a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:38.731948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0d56a-34dd-4ffb-8961-d7e36985a58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-55f0d56a-34dd-4ffb-8961-d7e36985a58a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:38.740001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:38.741690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:38.742796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 546/1089] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:38.747684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:38.751465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d56a-34dd-4ffb-8961-d7e36985a58a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:38.756341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c259a6-1f45-421a-9e01-b6f708fb707e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:38.814746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082cb2d-0aec-41e7-8014-0fc916b237d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:38.816075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082cb2d-0aec-41e7-8014-0fc916b237d0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:38.816550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082cb2d-0aec-41e7-8014-0fc916b237d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:38.817034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082cb2d-0aec-41e7-8014-0fc916b237d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:38.834836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082cb2d-0aec-41e7-8014-0fc916b237d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5082cb2d-0aec-41e7-8014-0fc916b237d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:38.845107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:38.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:38.848434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 544/1090] 10.222.0.90 () {56 vars in 1120 bytes} [Tue Jun 21 15:01:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:38.853314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082cb2d-0aec-41e7-8014-0fc916b237d0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:38.880991 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0d56a-34dd-4ffb-8961-d7e36985a58a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:38.883557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:38.923329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796b79-2ed1-4678-aac4-3179f54f1c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:38.924184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796b79-2ed1-4678-aac4-3179f54f1c58 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:38.924609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796b79-2ed1-4678-aac4-3179f54f1c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:38.925011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d796b79-2ed1-4678-aac4-3179f54f1c58 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:38.925963 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796b79-2ed1-4678-aac4-3179f54f1c58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:38.926417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796b79-2ed1-4678-aac4-3179f54f1c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:38.928450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d796b79-2ed1-4678-aac4-3179f54f1c58 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:38.942421 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 547/1091] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:38.950840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796b79-2ed1-4678-aac4-3179f54f1c58 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:38.994129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082cb2d-0aec-41e7-8014-0fc916b237d0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:39.035177 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65763-6e48-4d2c-98da-d6e3aa1326e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:39.035860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65763-6e48-4d2c-98da-d6e3aa1326e0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:39.036145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65763-6e48-4d2c-98da-d6e3aa1326e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:39.036425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65763-6e48-4d2c-98da-d6e3aa1326e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:39.037174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65763-6e48-4d2c-98da-d6e3aa1326e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:39.037513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65763-6e48-4d2c-98da-d6e3aa1326e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:39.038885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65763-6e48-4d2c-98da-d6e3aa1326e0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:39.049177 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 545/1092] 10.222.0.90 () {56 vars in 1115 bytes} [Tue Jun 21 15:01:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:39.058112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65763-6e48-4d2c-98da-d6e3aa1326e0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:39.084048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:39.092981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d796b79-2ed1-4678-aac4-3179f54f1c58 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:39.144108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a8855-e318-496c-b626-0650ce74696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:39.144993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a8855-e318-496c-b626-0650ce74696b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:39.145275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a8855-e318-496c-b626-0650ce74696b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:39.145591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a8855-e318-496c-b626-0650ce74696b None admin] PATH_INFO: `/v3/users/038a752cec52468988ca3911f54caab0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:39.146902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a8855-e318-496c-b626-0650ce74696b None admin] RBAC: Authorizing `identity:get_user(user_id=038a752cec52468988ca3911f54caab0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:39.148336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a8855-e318-496c-b626-0650ce74696b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:39.150094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 548/1093] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:38 2022] GET /identity/v3/users/038a752cec52468988ca3911f54caab0 => generated 285 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:39.157772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a8855-e318-496c-b626-0650ce74696b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:39.175507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65763-6e48-4d2c-98da-d6e3aa1326e0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:39.210616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:39.222893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13855db7-de15-478b-9045-ae11d2c11adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:39.224070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13855db7-de15-478b-9045-ae11d2c11adf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:39.224491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13855db7-de15-478b-9045-ae11d2c11adf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:39.224899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13855db7-de15-478b-9045-ae11d2c11adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:39.237726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13855db7-de15-478b-9045-ae11d2c11adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:39.239168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13855db7-de15-478b-9045-ae11d2c11adf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-13855db7-de15-478b-9045-ae11d2c11adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:39.257551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:39.258574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:39.260359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:39.260359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:39.260359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:39.260359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:39.260359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 546/1094] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:39.265423 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13855db7-de15-478b-9045-ae11d2c11adf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:39.289942 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a8855-e318-496c-b626-0650ce74696b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:39.328670 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d6365-03e1-418e-9068-095e94258314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:39.329330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d6365-03e1-418e-9068-095e94258314 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:39.329677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d6365-03e1-418e-9068-095e94258314 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:39.329953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d6365-03e1-418e-9068-095e94258314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:39.347960 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:39.396603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13855db7-de15-478b-9045-ae11d2c11adf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:39.427772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d6365-03e1-418e-9068-095e94258314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:39.430451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d6365-03e1-418e-9068-095e94258314 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:39.436375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70b89e-0027-4370-92ed-43cf19ee6563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:39.437388 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70b89e-0027-4370-92ed-43cf19ee6563 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:39.437828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70b89e-0027-4370-92ed-43cf19ee6563 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:39.438226 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70b89e-0027-4370-92ed-43cf19ee6563 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:39.439081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70b89e-0027-4370-92ed-43cf19ee6563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:39.439499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70b89e-0027-4370-92ed-43cf19ee6563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:39.441042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70b89e-0027-4370-92ed-43cf19ee6563 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:39.454950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 547/1095] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:39.464857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70b89e-0027-4370-92ed-43cf19ee6563 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:39.481005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:39.571773 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 549/1096] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 15:01:39.578471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d6365-03e1-418e-9068-095e94258314 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:39.584718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70b89e-0027-4370-92ed-43cf19ee6563 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:39.622109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:39.629439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f7478-eb70-4e72-8853-a2db36abf699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:39.630274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f7478-eb70-4e72-8853-a2db36abf699 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:39.630551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f7478-eb70-4e72-8853-a2db36abf699 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:39.630821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f7478-eb70-4e72-8853-a2db36abf699 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:39.638962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f7478-eb70-4e72-8853-a2db36abf699 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:39.640419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f7478-eb70-4e72-8853-a2db36abf699 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c26f7478-eb70-4e72-8853-a2db36abf699 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:01:39.655551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:39.656797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:39.658673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 548/1097] 10.222.0.90 () {56 vars in 1093 bytes} [Tue Jun 21 15:01:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:01:39.662502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f7478-eb70-4e72-8853-a2db36abf699 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:39.702484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d6365-03e1-418e-9068-095e94258314 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:39.739700 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55993db1-ec74-4bfc-ab02-7437f27d4992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:39.740564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55993db1-ec74-4bfc-ab02-7437f27d4992 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:39.740848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55993db1-ec74-4bfc-ab02-7437f27d4992 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:39.741220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55993db1-ec74-4bfc-ab02-7437f27d4992 None admin] PATH_INFO: `/v3/projects/37b1813771f84fada954ef68e60465f0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:39.742449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55993db1-ec74-4bfc-ab02-7437f27d4992 None admin] RBAC: Authorizing `identity:get_project(project_id=37b1813771f84fada954ef68e60465f0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:39.744669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55993db1-ec74-4bfc-ab02-7437f27d4992 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:39.746468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 550/1098] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:01:39 2022] GET /identity/v3/projects/37b1813771f84fada954ef68e60465f0 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:39.752775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55993db1-ec74-4bfc-ab02-7437f27d4992 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:39.755605 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:39.784895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f7478-eb70-4e72-8853-a2db36abf699 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:39.836181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591bed5-9359-49fd-a6e0-d79bf5b48c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:39.836772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591bed5-9359-49fd-a6e0-d79bf5b48c7d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:39.837133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591bed5-9359-49fd-a6e0-d79bf5b48c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:39.837409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591bed5-9359-49fd-a6e0-d79bf5b48c7d None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:39.838286 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591bed5-9359-49fd-a6e0-d79bf5b48c7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:39.838594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591bed5-9359-49fd-a6e0-d79bf5b48c7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:39.840161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591bed5-9359-49fd-a6e0-d79bf5b48c7d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:39.864038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 549/1099] 10.222.0.90 () {56 vars in 1133 bytes} [Tue Jun 21 15:01:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:39.871073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591bed5-9359-49fd-a6e0-d79bf5b48c7d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:39.892874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55993db1-ec74-4bfc-ab02-7437f27d4992 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:39.935656 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:39.936828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a079-d597-4d51-89b1-c27cc27a6389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:39.937513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a079-d597-4d51-89b1-c27cc27a6389 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:39.937811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a079-d597-4d51-89b1-c27cc27a6389 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:39.938089 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a079-d597-4d51-89b1-c27cc27a6389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:39.938930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04a079-d597-4d51-89b1-c27cc27a6389 None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=37b1813771f84fada954ef68e60465f0, user.id=038a752cec52468988ca3911f54caab0) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:39.939249 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04a079-d597-4d51-89b1-c27cc27a6389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:39.940724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04a079-d597-4d51-89b1-c27cc27a6389 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:39.947156 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 551/1100] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:39 2022] GET /identity/v3/role_assignments?user.id=038a752cec52468988ca3911f54caab0&scope.project.id=37b1813771f84fada954ef68e60465f0&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:39.997021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591bed5-9359-49fd-a6e0-d79bf5b48c7d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:40.047119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d799e62-48f0-412d-841a-985b4f22b842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:40.047807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799e62-48f0-412d-841a-985b4f22b842 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:40.048093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799e62-48f0-412d-841a-985b4f22b842 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:40.048376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799e62-48f0-412d-841a-985b4f22b842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:40.126538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d799e62-48f0-412d-841a-985b4f22b842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:40.127557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d799e62-48f0-412d-841a-985b4f22b842 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:40.185996 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:40.242487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 550/1101] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 15:01:40.248566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a079-d597-4d51-89b1-c27cc27a6389 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:40.329082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:40.367175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a079-d597-4d51-89b1-c27cc27a6389 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:40.403362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeca8da-f992-480a-8c5d-ef7801dbd470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:40.404087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeca8da-f992-480a-8c5d-ef7801dbd470 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:40.404373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeca8da-f992-480a-8c5d-ef7801dbd470 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:40.404652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeca8da-f992-480a-8c5d-ef7801dbd470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:40.418585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeca8da-f992-480a-8c5d-ef7801dbd470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:40.420050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeca8da-f992-480a-8c5d-ef7801dbd470 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6eeca8da-f992-480a-8c5d-ef7801dbd470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:01:40.439407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:40.440980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:40.442361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:01:40.442361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:01:40.442361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:01:40.442361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:40.442361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 552/1102] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:40.446500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d799e62-48f0-412d-841a-985b4f22b842 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:40.563557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d799e62-48f0-412d-841a-985b4f22b842 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:40.606957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e02b7-6b5e-430f-965d-286e0a2c0693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:40.607630 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e02b7-6b5e-430f-965d-286e0a2c0693 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:40.607915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e02b7-6b5e-430f-965d-286e0a2c0693 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:40.608191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e02b7-6b5e-430f-965d-286e0a2c0693 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:40.608909 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e02b7-6b5e-430f-965d-286e0a2c0693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:40.609218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e02b7-6b5e-430f-965d-286e0a2c0693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:40.610662 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e02b7-6b5e-430f-965d-286e0a2c0693 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:40.623927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 551/1103] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:40.629590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeca8da-f992-480a-8c5d-ef7801dbd470 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:40.747880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeca8da-f992-480a-8c5d-ef7801dbd470 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:40.767160 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:40.785293 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688403b0-e1ee-44f4-844f-b208a1b6e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:40.786107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688403b0-e1ee-44f4-844f-b208a1b6e921 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:40.786390 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688403b0-e1ee-44f4-844f-b208a1b6e921 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:40.786663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688403b0-e1ee-44f4-844f-b208a1b6e921 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:40.794269 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688403b0-e1ee-44f4-844f-b208a1b6e921 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:40.795920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688403b0-e1ee-44f4-844f-b208a1b6e921 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-688403b0-e1ee-44f4-844f-b208a1b6e921 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:01:40.809837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:40.811541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:40.813304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:01:40.813304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:01:40.813304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:01:40.813304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:01:40.813304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:01:40.813304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:01:40.813304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:01:40.813304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:01:40.813304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 553/1104] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:40.817249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e02b7-6b5e-430f-965d-286e0a2c0693 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:40.831785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:40.934079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e02b7-6b5e-430f-965d-286e0a2c0693 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:40.968629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21deb2-db36-4942-b99a-47b16152a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:40.969292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21deb2-db36-4942-b99a-47b16152a55a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:40.969607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21deb2-db36-4942-b99a-47b16152a55a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:40.969887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21deb2-db36-4942-b99a-47b16152a55a None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:40.971201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21deb2-db36-4942-b99a-47b16152a55a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:40.971512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21deb2-db36-4942-b99a-47b16152a55a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:40.972992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21deb2-db36-4942-b99a-47b16152a55a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:40.986203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 552/1105] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:40.992625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688403b0-e1ee-44f4-844f-b208a1b6e921 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:41.103125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688403b0-e1ee-44f4-844f-b208a1b6e921 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:41.143380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5461e9-f053-4114-966d-ab47832be2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:41.144061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5461e9-f053-4114-966d-ab47832be2fc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:41.144349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5461e9-f053-4114-966d-ab47832be2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:41.144652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5461e9-f053-4114-966d-ab47832be2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:41.145625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5461e9-f053-4114-966d-ab47832be2fc None admin] RBAC: Adding query filter params (role.id=4e80c2f6fbb84dad8a1fd3ff04caa94e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=2bd3ffc0a30648139b2cbf19bb6bd535) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:41.145959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5461e9-f053-4114-966d-ab47832be2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:41.147540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5461e9-f053-4114-966d-ab47832be2fc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:41.154801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 554/1106] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:40 2022] GET /identity/v3/role_assignments?user.id=2bd3ffc0a30648139b2cbf19bb6bd535&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4e80c2f6fbb84dad8a1fd3ff04caa94e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:42.120718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa0216-2e16-4ec9-9e18-331e50555202 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:42.121253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa0216-2e16-4ec9-9e18-331e50555202 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:42.121766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa0216-2e16-4ec9-9e18-331e50555202 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:42.123769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 553/1107] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:42.129738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358253b-4ae2-4be9-b55b-b4c838629d74 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:42.130251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358253b-4ae2-4be9-b55b-b4c838629d74 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:42.130251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358253b-4ae2-4be9-b55b-b4c838629d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:42.151377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3358253b-4ae2-4be9-b55b-b4c838629d74 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:42.152918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3358253b-4ae2-4be9-b55b-b4c838629d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:42.201289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:42.234815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 555/1108] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:42.262225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa0216-2e16-4ec9-9e18-331e50555202 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:42.333426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:42.369354 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa0216-2e16-4ec9-9e18-331e50555202 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:42.404310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9e40b-efc9-4b9b-b8cb-1ac321c56ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:42.405097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9e40b-efc9-4b9b-b8cb-1ac321c56ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:42.405390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9e40b-efc9-4b9b-b8cb-1ac321c56ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:42.405694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9e40b-efc9-4b9b-b8cb-1ac321c56ea1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:42.406891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9e40b-efc9-4b9b-b8cb-1ac321c56ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:42.408332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9e40b-efc9-4b9b-b8cb-1ac321c56ea1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:42.410009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 554/1109] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:42.416575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358253b-4ae2-4be9-b55b-b4c838629d74 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:42.529823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358253b-4ae2-4be9-b55b-b4c838629d74 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:42.566761 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0959e18-55bc-4892-8899-1d3c4de08d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:42.567465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959e18-55bc-4892-8899-1d3c4de08d3c None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:42.567706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959e18-55bc-4892-8899-1d3c4de08d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:42.567984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959e18-55bc-4892-8899-1d3c4de08d3c None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:42.568699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0959e18-55bc-4892-8899-1d3c4de08d3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:42.570158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0959e18-55bc-4892-8899-1d3c4de08d3c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:42.590215 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 556/1110] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:01:42 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:44.745265 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470049-9256-41df-a05f-9bd33a401a17 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:44.745845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470049-9256-41df-a05f-9bd33a401a17 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:44.745845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a470049-9256-41df-a05f-9bd33a401a17 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:44.747223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 555/1111] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:44.752511 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaad01-0c36-4864-a077-6bfe1b709e70 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:44.752968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaad01-0c36-4864-a077-6bfe1b709e70 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:44.753075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaad01-0c36-4864-a077-6bfe1b709e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:44.770281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4caaad01-0c36-4864-a077-6bfe1b709e70 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:44.771471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4caaad01-0c36-4864-a077-6bfe1b709e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:44.795081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:44.840931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 557/1112] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:44.864907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a470049-9256-41df-a05f-9bd33a401a17 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:44.969423 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a470049-9256-41df-a05f-9bd33a401a17 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:45.004759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3618c9-c699-4448-b318-c931bc64bff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:45.005550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3618c9-c699-4448-b318-c931bc64bff7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:45.005836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3618c9-c699-4448-b318-c931bc64bff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:45.006111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3618c9-c699-4448-b318-c931bc64bff7 None admin] PATH_INFO: `/v3/roles/b1558d27591d4ee3b4070a19333d6180` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:45.007579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3618c9-c699-4448-b318-c931bc64bff7 None admin] RBAC: Authorizing `identity:get_role(role_id=b1558d27591d4ee3b4070a19333d6180)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:45.008980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3618c9-c699-4448-b318-c931bc64bff7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:45.010475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 556/1113] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:44 2022] GET /identity/v3/roles/b1558d27591d4ee3b4070a19333d6180 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:45.017730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaad01-0c36-4864-a077-6bfe1b709e70 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:45.120907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaad01-0c36-4864-a077-6bfe1b709e70 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:45.157132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867f1e-0d93-4505-951a-f76674104ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:45.158067 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867f1e-0d93-4505-951a-f76674104ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:45.158408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867f1e-0d93-4505-951a-f76674104ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:45.158629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af867f1e-0d93-4505-951a-f76674104ca7 None admin] PATH_INFO: `/v3/users/1b6efe9ce8174833a59a092d0f3ddba0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:45.172893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af867f1e-0d93-4505-951a-f76674104ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=1b6efe9ce8174833a59a092d0f3ddba0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:45.174379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af867f1e-0d93-4505-951a-f76674104ca7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:45.176042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 558/1114] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:45 2022] GET /identity/v3/users/1b6efe9ce8174833a59a092d0f3ddba0 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:45.182371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3618c9-c699-4448-b318-c931bc64bff7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:45.186208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:45.282032 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3618c9-c699-4448-b318-c931bc64bff7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:45.316426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a831fcd-6c23-4b9c-ad47-19fc64882a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:45.317069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a831fcd-6c23-4b9c-ad47-19fc64882a6e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:45.317352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a831fcd-6c23-4b9c-ad47-19fc64882a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:45.317666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a831fcd-6c23-4b9c-ad47-19fc64882a6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:45.384985 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a831fcd-6c23-4b9c-ad47-19fc64882a6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:45.386471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a831fcd-6c23-4b9c-ad47-19fc64882a6e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:45.389122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:45.482857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 557/1115] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 15:01:45.489012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867f1e-0d93-4505-951a-f76674104ca7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:45.512935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:45.595690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af867f1e-0d93-4505-951a-f76674104ca7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:45.630578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe7a69-9452-4acf-a464-14143f3dfab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:45.631427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe7a69-9452-4acf-a464-14143f3dfab8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:45.631706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe7a69-9452-4acf-a464-14143f3dfab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:45.631978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe7a69-9452-4acf-a464-14143f3dfab8 None admin] PATH_INFO: `/v3/projects/37b1813771f84fada954ef68e60465f0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:45.633221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe7a69-9452-4acf-a464-14143f3dfab8 None admin] RBAC: Authorizing `identity:get_project(project_id=37b1813771f84fada954ef68e60465f0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:45.634957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe7a69-9452-4acf-a464-14143f3dfab8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:45.636735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 559/1116] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:01:45 2022] GET /identity/v3/projects/37b1813771f84fada954ef68e60465f0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:45.643008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a831fcd-6c23-4b9c-ad47-19fc64882a6e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:45.744789 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a831fcd-6c23-4b9c-ad47-19fc64882a6e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:45.747136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:45.779351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aad1c4-6719-4c28-b414-82d91015b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:45.780017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad1c4-6719-4c28-b414-82d91015b351 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:45.780302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad1c4-6719-4c28-b414-82d91015b351 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:45.780579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad1c4-6719-4c28-b414-82d91015b351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:45.781417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aad1c4-6719-4c28-b414-82d91015b351 None admin] RBAC: Adding query filter params (role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=37b1813771f84fada954ef68e60465f0, user.id=1b6efe9ce8174833a59a092d0f3ddba0) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:45.781757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aad1c4-6719-4c28-b414-82d91015b351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:45.783187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aad1c4-6719-4c28-b414-82d91015b351 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:45.788904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 558/1117] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:45 2022] GET /identity/v3/role_assignments?user.id=1b6efe9ce8174833a59a092d0f3ddba0&scope.project.id=37b1813771f84fada954ef68e60465f0&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:47.836408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1757eb-b278-485b-9cbf-54be336cfcd9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:47.837122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1757eb-b278-485b-9cbf-54be336cfcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:47.837122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1757eb-b278-485b-9cbf-54be336cfcd9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:47.839179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 560/1118] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:47.844796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3185d-2025-4c31-b2c3-cdcf5f773e0c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:47.845517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3185d-2025-4c31-b2c3-cdcf5f773e0c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:47.845766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3185d-2025-4c31-b2c3-cdcf5f773e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:47.863109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b5c3185d-2025-4c31-b2c3-cdcf5f773e0c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:47.864310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b5c3185d-2025-4c31-b2c3-cdcf5f773e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:47.939660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 559/1119] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:47.964983 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1757eb-b278-485b-9cbf-54be336cfcd9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:48.054669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:48.073881 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1757eb-b278-485b-9cbf-54be336cfcd9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:48.109589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd53f40-1142-4e80-a3eb-44a25b6899a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:48.110359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd53f40-1142-4e80-a3eb-44a25b6899a1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:48.110646 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd53f40-1142-4e80-a3eb-44a25b6899a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:48.110932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd53f40-1142-4e80-a3eb-44a25b6899a1 None admin] PATH_INFO: `/v3/roles/b1558d27591d4ee3b4070a19333d6180` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:48.112482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd53f40-1142-4e80-a3eb-44a25b6899a1 None admin] RBAC: Authorizing `identity:get_role(role_id=b1558d27591d4ee3b4070a19333d6180)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:48.113951 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd53f40-1142-4e80-a3eb-44a25b6899a1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:48.115359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 561/1120] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:47 2022] GET /identity/v3/roles/b1558d27591d4ee3b4070a19333d6180 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:48.122644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3185d-2025-4c31-b2c3-cdcf5f773e0c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:48.222092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:48.226193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3185d-2025-4c31-b2c3-cdcf5f773e0c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:48.271890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945be9a-f92b-4684-8c76-1d5435a90b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:48.272761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945be9a-f92b-4684-8c76-1d5435a90b8c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:48.273049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945be9a-f92b-4684-8c76-1d5435a90b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:48.273321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945be9a-f92b-4684-8c76-1d5435a90b8c None admin] PATH_INFO: `/v3/users/1b6efe9ce8174833a59a092d0f3ddba0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:48.274700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945be9a-f92b-4684-8c76-1d5435a90b8c None admin] RBAC: Authorizing `identity:get_user(user_id=1b6efe9ce8174833a59a092d0f3ddba0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:48.276245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945be9a-f92b-4684-8c76-1d5435a90b8c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:48.277971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 560/1121] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:48 2022] GET /identity/v3/users/1b6efe9ce8174833a59a092d0f3ddba0 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:48.284314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd53f40-1142-4e80-a3eb-44a25b6899a1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:48.392627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd53f40-1142-4e80-a3eb-44a25b6899a1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:48.431530 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d404a-4b58-412d-85a3-54d06610833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:48.432612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d404a-4b58-412d-85a3-54d06610833f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:48.432899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d404a-4b58-412d-85a3-54d06610833f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:48.433266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d404a-4b58-412d-85a3-54d06610833f None admin] PATH_INFO: `/v3/projects/37b1813771f84fada954ef68e60465f0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:48.434720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d404a-4b58-412d-85a3-54d06610833f None admin] RBAC: Authorizing `identity:get_project(project_id=37b1813771f84fada954ef68e60465f0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:48.436255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d404a-4b58-412d-85a3-54d06610833f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:48.438274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 562/1122] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:01:48 2022] GET /identity/v3/projects/37b1813771f84fada954ef68e60465f0 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:48.444448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945be9a-f92b-4684-8c76-1d5435a90b8c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:48.553757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945be9a-f92b-4684-8c76-1d5435a90b8c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:48.604041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a045c2-a35b-4579-a02d-2dda4b60c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:48.604939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a045c2-a35b-4579-a02d-2dda4b60c881 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:48.605226 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a045c2-a35b-4579-a02d-2dda4b60c881 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:48.605525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a045c2-a35b-4579-a02d-2dda4b60c881 None admin] PATH_INFO: `/v3/projects/37b1813771f84fada954ef68e60465f0/users/1b6efe9ce8174833a59a092d0f3ddba0/roles/b1558d27591d4ee3b4070a19333d6180` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:48.607780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a045c2-a35b-4579-a02d-2dda4b60c881 None admin] RBAC: Authorizing `identity:create_grant(project_id=37b1813771f84fada954ef68e60465f0, user_id=1b6efe9ce8174833a59a092d0f3ddba0, role_id=b1558d27591d4ee3b4070a19333d6180)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:48.609218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a045c2-a35b-4579-a02d-2dda4b60c881 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:48.623596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 561/1123] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:01:48 2022] PUT /identity/v3/projects/37b1813771f84fada954ef68e60465f0/users/1b6efe9ce8174833a59a092d0f3ddba0/roles/b1558d27591d4ee3b4070a19333d6180 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:01:50.690551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c859a-45bf-4185-9ec9-8d090017f78a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:50.691112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c859a-45bf-4185-9ec9-8d090017f78a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:50.691383 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c859a-45bf-4185-9ec9-8d090017f78a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:50.693309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 563/1124] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:50.699630 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18173-5ecd-4ef7-a5d7-df76f3cb82e4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:50.700109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18173-5ecd-4ef7-a5d7-df76f3cb82e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:50.700201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb18173-5ecd-4ef7-a5d7-df76f3cb82e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:50.720389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4fb18173-5ecd-4ef7-a5d7-df76f3cb82e4 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:50.721601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4fb18173-5ecd-4ef7-a5d7-df76f3cb82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:50.743315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:50.800272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 562/1125] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:50.826186 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c859a-45bf-4185-9ec9-8d090017f78a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:50.848817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:50.932618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c859a-45bf-4185-9ec9-8d090017f78a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:50.977424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8c320-2db4-4204-bf9d-9d1f1b76cc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:50.978703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c320-2db4-4204-bf9d-9d1f1b76cc7d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:50.979121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c320-2db4-4204-bf9d-9d1f1b76cc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:50.979536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c320-2db4-4204-bf9d-9d1f1b76cc7d None admin] PATH_INFO: `/v3/roles/b1558d27591d4ee3b4070a19333d6180` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:50.981874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8c320-2db4-4204-bf9d-9d1f1b76cc7d None admin] RBAC: Authorizing `identity:get_role(role_id=b1558d27591d4ee3b4070a19333d6180)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:50.983997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8c320-2db4-4204-bf9d-9d1f1b76cc7d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:50.987041 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 564/1126] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:50 2022] GET /identity/v3/roles/b1558d27591d4ee3b4070a19333d6180 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:50.992885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb18173-5ecd-4ef7-a5d7-df76f3cb82e4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:51.116125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb18173-5ecd-4ef7-a5d7-df76f3cb82e4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:51.152563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e121a19-3d2e-42f6-9042-cb65a5a27a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:51.153521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e121a19-3d2e-42f6-9042-cb65a5a27a29 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:51.153794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e121a19-3d2e-42f6-9042-cb65a5a27a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:51.154081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e121a19-3d2e-42f6-9042-cb65a5a27a29 None admin] PATH_INFO: `/v3/users/1b6efe9ce8174833a59a092d0f3ddba0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:51.155280 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e121a19-3d2e-42f6-9042-cb65a5a27a29 None admin] RBAC: Authorizing `identity:get_user(user_id=1b6efe9ce8174833a59a092d0f3ddba0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:51.156791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e121a19-3d2e-42f6-9042-cb65a5a27a29 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:51.159140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 563/1127] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:50 2022] GET /identity/v3/users/1b6efe9ce8174833a59a092d0f3ddba0 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:51.167308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8c320-2db4-4204-bf9d-9d1f1b76cc7d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:51.274094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:51.287596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8c320-2db4-4204-bf9d-9d1f1b76cc7d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:51.324242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd636264-b544-4667-b852-5f2571007f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:51.324892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd636264-b544-4667-b852-5f2571007f68 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:51.325178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd636264-b544-4667-b852-5f2571007f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:51.325459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd636264-b544-4667-b852-5f2571007f68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:51.420067 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd636264-b544-4667-b852-5f2571007f68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:51.421570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd636264-b544-4667-b852-5f2571007f68 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:51.545194 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:51.564091 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 565/1128] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:01:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 15:01:51.572779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e121a19-3d2e-42f6-9042-cb65a5a27a29 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:51.608880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:51.708968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e121a19-3d2e-42f6-9042-cb65a5a27a29 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:51.748718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc46ecb-378d-4fe7-9d10-6c7965cbf62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:51.749614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc46ecb-378d-4fe7-9d10-6c7965cbf62d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:51.749902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc46ecb-378d-4fe7-9d10-6c7965cbf62d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:51.750186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc46ecb-378d-4fe7-9d10-6c7965cbf62d None admin] PATH_INFO: `/v3/projects/37b1813771f84fada954ef68e60465f0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:51.751415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc46ecb-378d-4fe7-9d10-6c7965cbf62d None admin] RBAC: Authorizing `identity:get_project(project_id=37b1813771f84fada954ef68e60465f0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:51.752863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc46ecb-378d-4fe7-9d10-6c7965cbf62d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:51.754650 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 564/1129] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:01:51 2022] GET /identity/v3/projects/37b1813771f84fada954ef68e60465f0 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:51.761434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd636264-b544-4667-b852-5f2571007f68 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:51.878381 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd636264-b544-4667-b852-5f2571007f68 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:51.918181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4624f-d2b4-41ee-8127-efd5ab270995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:51.918857 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4624f-d2b4-41ee-8127-efd5ab270995 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:51.919143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4624f-d2b4-41ee-8127-efd5ab270995 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:51.919424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4624f-d2b4-41ee-8127-efd5ab270995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:51.920272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4624f-d2b4-41ee-8127-efd5ab270995 None admin] RBAC: Adding query filter params (role.id=b1558d27591d4ee3b4070a19333d6180, scope.project.id=37b1813771f84fada954ef68e60465f0, user.id=1b6efe9ce8174833a59a092d0f3ddba0) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:51.920586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4624f-d2b4-41ee-8127-efd5ab270995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:51.922099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4624f-d2b4-41ee-8127-efd5ab270995 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:51.929204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 566/1130] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:01:51 2022] GET /identity/v3/role_assignments?user.id=1b6efe9ce8174833a59a092d0f3ddba0&scope.project.id=37b1813771f84fada954ef68e60465f0&role.id=b1558d27591d4ee3b4070a19333d6180 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:54.009520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684eb8-4e18-473b-906d-e584a3c8dc70 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:54.010082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684eb8-4e18-473b-906d-e584a3c8dc70 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:54.010082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684eb8-4e18-473b-906d-e584a3c8dc70 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:54.011433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 565/1131] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:54.016706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c024c6-0ea9-4687-b957-d0af6749befa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:54.017163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c024c6-0ea9-4687-b957-d0af6749befa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:54.017283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c024c6-0ea9-4687-b957-d0af6749befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:54.034046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-37c024c6-0ea9-4687-b957-d0af6749befa None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:54.035235 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-37c024c6-0ea9-4687-b957-d0af6749befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:54.086589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:54.106742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 567/1132] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:54.130969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684eb8-4e18-473b-906d-e584a3c8dc70 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:54.225314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:54.237918 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684eb8-4e18-473b-906d-e584a3c8dc70 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:54.280485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9a987-6e3a-4579-86cc-9cb5276d0771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:54.281274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9a987-6e3a-4579-86cc-9cb5276d0771 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:54.281583 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9a987-6e3a-4579-86cc-9cb5276d0771 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:54.281861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9a987-6e3a-4579-86cc-9cb5276d0771 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:54.283038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9a987-6e3a-4579-86cc-9cb5276d0771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:54.284465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9a987-6e3a-4579-86cc-9cb5276d0771 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:54.286105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 566/1133] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:54.292239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c024c6-0ea9-4687-b957-d0af6749befa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:54.402940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c024c6-0ea9-4687-b957-d0af6749befa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:54.440472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80863f-6ae0-4853-b1ab-5fec1f895ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:54.441122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80863f-6ae0-4853-b1ab-5fec1f895ce7 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:54.441413 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80863f-6ae0-4853-b1ab-5fec1f895ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:54.441722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80863f-6ae0-4853-b1ab-5fec1f895ce7 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:54.442483 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80863f-6ae0-4853-b1ab-5fec1f895ce7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:54.443871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80863f-6ae0-4853-b1ab-5fec1f895ce7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:54.470804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 568/1134] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:01:54 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:56.695250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b49f45-fb0a-460a-a6b2-29ca8d10487a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:56.695994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b49f45-fb0a-460a-a6b2-29ca8d10487a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:56.695994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b49f45-fb0a-460a-a6b2-29ca8d10487a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:56.697172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 567/1135] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:56.703652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdbd87-8223-4fa3-ad9c-6d034044423c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:56.704216 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdbd87-8223-4fa3-ad9c-6d034044423c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:56.704389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdbd87-8223-4fa3-ad9c-6d034044423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:56.725019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-32bdbd87-8223-4fa3-ad9c-6d034044423c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:56.726683 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-32bdbd87-8223-4fa3-ad9c-6d034044423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:56.761949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:56.812018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 569/1136] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:56.838311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b49f45-fb0a-460a-a6b2-29ca8d10487a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:56.958145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b49f45-fb0a-460a-a6b2-29ca8d10487a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:56.990145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c9a5a-f592-4211-8cd2-53832ed7bff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:56.990939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9a5a-f592-4211-8cd2-53832ed7bff9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:56.991216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9a5a-f592-4211-8cd2-53832ed7bff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:56.991496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9a5a-f592-4211-8cd2-53832ed7bff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:56.992768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c9a5a-f592-4211-8cd2-53832ed7bff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:56.994459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c9a5a-f592-4211-8cd2-53832ed7bff9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:56.996071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 568/1137] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:01:57.002969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdbd87-8223-4fa3-ad9c-6d034044423c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:57.117860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdbd87-8223-4fa3-ad9c-6d034044423c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:57.163072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50472137-b858-4b9f-af3a-d5ce76eb42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:57.163750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50472137-b858-4b9f-af3a-d5ce76eb42bc None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:57.164036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50472137-b858-4b9f-af3a-d5ce76eb42bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:57.164320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50472137-b858-4b9f-af3a-d5ce76eb42bc None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:57.165505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50472137-b858-4b9f-af3a-d5ce76eb42bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:57.167203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50472137-b858-4b9f-af3a-d5ce76eb42bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:57.192723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 570/1138] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:01:57 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:01:59.420978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ed7ed-c0cb-489d-9c6c-eab97c540bef None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:59.421601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ed7ed-c0cb-489d-9c6c-eab97c540bef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:59.421601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ed7ed-c0cb-489d-9c6c-eab97c540bef None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:59.423274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 569/1139] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:01:59.429740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102913a7-1c81-403d-a185-b5d600530213 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:59.430880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102913a7-1c81-403d-a185-b5d600530213 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:59.431216 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102913a7-1c81-403d-a185-b5d600530213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:59.449305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-102913a7-1c81-403d-a185-b5d600530213 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:01:59.450527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-102913a7-1c81-403d-a185-b5d600530213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:01:59.468629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:59.531197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 571/1140] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:01:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:01:59.555551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ed7ed-c0cb-489d-9c6c-eab97c540bef None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:59.588407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:01:59.688871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ed7ed-c0cb-489d-9c6c-eab97c540bef None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:59.730260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8298b6-e113-4748-9b8b-aff1eae667a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:59.731055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8298b6-e113-4748-9b8b-aff1eae667a9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:59.731341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8298b6-e113-4748-9b8b-aff1eae667a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:59.731621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8298b6-e113-4748-9b8b-aff1eae667a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:59.743211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8298b6-e113-4748-9b8b-aff1eae667a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7a8298b6-e113-4748-9b8b-aff1eae667a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:01:59.751103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:01:59.752393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:01:59.753363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 570/1141] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:01:59.759556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102913a7-1c81-403d-a185-b5d600530213 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:01:59.862870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102913a7-1c81-403d-a185-b5d600530213 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:01:59.897849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6602b2-40b5-4966-994c-3223ec704366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:01:59.898518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6602b2-40b5-4966-994c-3223ec704366 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:01:59.898801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6602b2-40b5-4966-994c-3223ec704366 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:01:59.899082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6602b2-40b5-4966-994c-3223ec704366 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:01:59.899864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6602b2-40b5-4966-994c-3223ec704366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:01:59.900180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6602b2-40b5-4966-994c-3223ec704366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:01:59.901575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6602b2-40b5-4966-994c-3223ec704366 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:01:59.910224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 572/1142] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:01:59.920765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8298b6-e113-4748-9b8b-aff1eae667a9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:00.020026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:00.032355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8298b6-e113-4748-9b8b-aff1eae667a9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:00.067604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0f5a-cadb-4b08-a4ae-f59e536c328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:00.068473 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0f5a-cadb-4b08-a4ae-f59e536c328a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:00.068755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0f5a-cadb-4b08-a4ae-f59e536c328a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:00.069031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0f5a-cadb-4b08-a4ae-f59e536c328a None admin] PATH_INFO: `/v3/users/e669416906884990a60a80e3f7c3d1d5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:00.082777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b0f5a-cadb-4b08-a4ae-f59e536c328a None admin] RBAC: Authorizing `identity:get_user(user_id=e669416906884990a60a80e3f7c3d1d5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:00.084224 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b0f5a-cadb-4b08-a4ae-f59e536c328a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:00.086017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 571/1143] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:01:59 2022] GET /identity/v3/users/e669416906884990a60a80e3f7c3d1d5 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:00.092251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6602b2-40b5-4966-994c-3223ec704366 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:00.108911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:00.206079 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6602b2-40b5-4966-994c-3223ec704366 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:00.242406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e94093-499a-4207-8e34-c85559b94462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:00.243054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e94093-499a-4207-8e34-c85559b94462 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:00.243343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e94093-499a-4207-8e34-c85559b94462 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:00.243686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e94093-499a-4207-8e34-c85559b94462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:00.316807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e94093-499a-4207-8e34-c85559b94462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:00.318215 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e94093-499a-4207-8e34-c85559b94462 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:00.336867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:00.440603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 573/1144] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:02:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:02:00.447230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0f5a-cadb-4b08-a4ae-f59e536c328a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:00.551938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0f5a-cadb-4b08-a4ae-f59e536c328a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:00.599201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817162c1-ceec-408a-8f87-b14c49295687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:00.600393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817162c1-ceec-408a-8f87-b14c49295687 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:00.600824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817162c1-ceec-408a-8f87-b14c49295687 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:00.601253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817162c1-ceec-408a-8f87-b14c49295687 None admin] PATH_INFO: `/v3/projects/9c9669f167fb490abf325daf723471c8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:00.603076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817162c1-ceec-408a-8f87-b14c49295687 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9669f167fb490abf325daf723471c8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:00.605318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817162c1-ceec-408a-8f87-b14c49295687 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:00.608175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 572/1145] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:02:00 2022] GET /identity/v3/projects/9c9669f167fb490abf325daf723471c8 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:00.614167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e94093-499a-4207-8e34-c85559b94462 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:00.718547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e94093-499a-4207-8e34-c85559b94462 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:00.731685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:00.753302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01efbb9-fe0e-4282-802a-5cba82b84dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:00.753986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01efbb9-fe0e-4282-802a-5cba82b84dcf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:00.754271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01efbb9-fe0e-4282-802a-5cba82b84dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:00.754550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01efbb9-fe0e-4282-802a-5cba82b84dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:00.755368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01efbb9-fe0e-4282-802a-5cba82b84dcf None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=9c9669f167fb490abf325daf723471c8, user.id=e669416906884990a60a80e3f7c3d1d5) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:00.755680 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01efbb9-fe0e-4282-802a-5cba82b84dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:00.757098 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01efbb9-fe0e-4282-802a-5cba82b84dcf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:00.763122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 574/1146] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:02:00 2022] GET /identity/v3/role_assignments?user.id=e669416906884990a60a80e3f7c3d1d5&scope.project.id=9c9669f167fb490abf325daf723471c8&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:02.879533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21d94-9f21-44da-88f2-0c8943748713 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:02.880078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21d94-9f21-44da-88f2-0c8943748713 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:02.880078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21d94-9f21-44da-88f2-0c8943748713 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:02.881435 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 573/1147] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:02:02.888490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a555a-37ad-4e89-934d-4b4622fbb6da None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:02.889041 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a555a-37ad-4e89-934d-4b4622fbb6da None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:02.889208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a555a-37ad-4e89-934d-4b4622fbb6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:02.913719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-164a555a-37ad-4e89-934d-4b4622fbb6da None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:02:02.916653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-164a555a-37ad-4e89-934d-4b4622fbb6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:02:02.997254 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 575/1148] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:02:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:02:03.026035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b21d94-9f21-44da-88f2-0c8943748713 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:03.043570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:03.142231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b21d94-9f21-44da-88f2-0c8943748713 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:03.186055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f419fd7-b7d6-4f9d-8115-d6f812dd72b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:03.186840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f419fd7-b7d6-4f9d-8115-d6f812dd72b2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:03.187126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f419fd7-b7d6-4f9d-8115-d6f812dd72b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:03.187391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f419fd7-b7d6-4f9d-8115-d6f812dd72b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:03.199937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f419fd7-b7d6-4f9d-8115-d6f812dd72b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3f419fd7-b7d6-4f9d-8115-d6f812dd72b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:02:03.207806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:02:03.209065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:02:03.210513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 574/1149] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:02:03.215489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a555a-37ad-4e89-934d-4b4622fbb6da None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:03.330726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a555a-37ad-4e89-934d-4b4622fbb6da None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:03.338342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:03.375914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83d148-1766-4c74-bbb6-ebec3fa29f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:03.376609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83d148-1766-4c74-bbb6-ebec3fa29f9e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:03.376895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83d148-1766-4c74-bbb6-ebec3fa29f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:03.377175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83d148-1766-4c74-bbb6-ebec3fa29f9e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:03.377963 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83d148-1766-4c74-bbb6-ebec3fa29f9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:03.378307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83d148-1766-4c74-bbb6-ebec3fa29f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:03.379677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83d148-1766-4c74-bbb6-ebec3fa29f9e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:03.389445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 576/1150] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:03.395398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f419fd7-b7d6-4f9d-8115-d6f812dd72b2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:03.476614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:03.506948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f419fd7-b7d6-4f9d-8115-d6f812dd72b2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:03.556296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf8dee-7899-4911-94b2-8560207ab184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:03.557169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8dee-7899-4911-94b2-8560207ab184 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:03.557454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8dee-7899-4911-94b2-8560207ab184 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:03.557756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8dee-7899-4911-94b2-8560207ab184 None admin] PATH_INFO: `/v3/users/e669416906884990a60a80e3f7c3d1d5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:03.558951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf8dee-7899-4911-94b2-8560207ab184 None admin] RBAC: Authorizing `identity:get_user(user_id=e669416906884990a60a80e3f7c3d1d5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:03.560398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf8dee-7899-4911-94b2-8560207ab184 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:03.562075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 575/1151] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:02:03 2022] GET /identity/v3/users/e669416906884990a60a80e3f7c3d1d5 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:03.567842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83d148-1766-4c74-bbb6-ebec3fa29f9e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:03.666634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83d148-1766-4c74-bbb6-ebec3fa29f9e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:03.700005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e461f-793f-4111-b01f-5ec2986bfef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:03.700864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e461f-793f-4111-b01f-5ec2986bfef9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:03.701148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e461f-793f-4111-b01f-5ec2986bfef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:03.701427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e461f-793f-4111-b01f-5ec2986bfef9 None admin] PATH_INFO: `/v3/projects/9c9669f167fb490abf325daf723471c8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:03.702634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e461f-793f-4111-b01f-5ec2986bfef9 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9669f167fb490abf325daf723471c8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:03.704079 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e461f-793f-4111-b01f-5ec2986bfef9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:03.705801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 577/1152] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:02:03 2022] GET /identity/v3/projects/9c9669f167fb490abf325daf723471c8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:03.712288 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf8dee-7899-4911-94b2-8560207ab184 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:03.814142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf8dee-7899-4911-94b2-8560207ab184 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:03.859998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406d2f3-2762-4a1a-837b-b528910153eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:03.861503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d2f3-2762-4a1a-837b-b528910153eb None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:03.862019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d2f3-2762-4a1a-837b-b528910153eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:03.862503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d2f3-2762-4a1a-837b-b528910153eb None admin] PATH_INFO: `/v3/projects/9c9669f167fb490abf325daf723471c8/users/e669416906884990a60a80e3f7c3d1d5/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:03.865270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406d2f3-2762-4a1a-837b-b528910153eb None admin] RBAC: Authorizing `identity:create_grant(project_id=9c9669f167fb490abf325daf723471c8, user_id=e669416906884990a60a80e3f7c3d1d5, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:03.866770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406d2f3-2762-4a1a-837b-b528910153eb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:03.884828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 576/1153] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:02:03 2022] PUT /identity/v3/projects/9c9669f167fb490abf325daf723471c8/users/e669416906884990a60a80e3f7c3d1d5/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:02:05.973043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840a83-e458-4f23-b21b-2bfd323f2ffe None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:05.973582 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840a83-e458-4f23-b21b-2bfd323f2ffe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:05.973700 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840a83-e458-4f23-b21b-2bfd323f2ffe None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:05.974976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 578/1154] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:02:05.980972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f99c7-518d-4cd3-b08f-762a8e059a69 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:05.981387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f99c7-518d-4cd3-b08f-762a8e059a69 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:05.981566 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f99c7-518d-4cd3-b08f-762a8e059a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:05.986522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:06.000626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a32f99c7-518d-4cd3-b08f-762a8e059a69 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:02:06.001820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a32f99c7-518d-4cd3-b08f-762a8e059a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:02:06.066646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 577/1155] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:02:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:02:06.090949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840a83-e458-4f23-b21b-2bfd323f2ffe None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:06.127998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:06.193327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840a83-e458-4f23-b21b-2bfd323f2ffe None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:06.225815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dbc6f-a872-44a4-b8ae-daf45f130219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:06.226597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dbc6f-a872-44a4-b8ae-daf45f130219 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:06.227411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dbc6f-a872-44a4-b8ae-daf45f130219 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:06.227688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dbc6f-a872-44a4-b8ae-daf45f130219 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:06.237935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9dbc6f-a872-44a4-b8ae-daf45f130219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fc9dbc6f-a872-44a4-b8ae-daf45f130219 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:02:06.245688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:02:06.246734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:02:06.247597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 579/1156] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:02:06.252870 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f99c7-518d-4cd3-b08f-762a8e059a69 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:06.350403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f99c7-518d-4cd3-b08f-762a8e059a69 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:06.379275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:06.385869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032ee41-17c1-401a-a06c-b79ee7e94f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:06.386532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ee41-17c1-401a-a06c-b79ee7e94f7e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:06.386817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ee41-17c1-401a-a06c-b79ee7e94f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:06.387093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ee41-17c1-401a-a06c-b79ee7e94f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:06.387833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032ee41-17c1-401a-a06c-b79ee7e94f7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:06.388146 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032ee41-17c1-401a-a06c-b79ee7e94f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:06.389527 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032ee41-17c1-401a-a06c-b79ee7e94f7e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:06.397568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 578/1157] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:06.403926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dbc6f-a872-44a4-b8ae-daf45f130219 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:06.497430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:06.503358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dbc6f-a872-44a4-b8ae-daf45f130219 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:06.536739 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5109b5c-1e94-4193-b375-23792b07e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:06.537623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5109b5c-1e94-4193-b375-23792b07e788 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:06.537925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5109b5c-1e94-4193-b375-23792b07e788 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:06.538204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5109b5c-1e94-4193-b375-23792b07e788 None admin] PATH_INFO: `/v3/users/e669416906884990a60a80e3f7c3d1d5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:06.539464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5109b5c-1e94-4193-b375-23792b07e788 None admin] RBAC: Authorizing `identity:get_user(user_id=e669416906884990a60a80e3f7c3d1d5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:06.541140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5109b5c-1e94-4193-b375-23792b07e788 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:06.542764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 580/1158] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:02:06 2022] GET /identity/v3/users/e669416906884990a60a80e3f7c3d1d5 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:06.548499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032ee41-17c1-401a-a06c-b79ee7e94f7e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:06.671143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032ee41-17c1-401a-a06c-b79ee7e94f7e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:06.714211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d34447-1b75-45d4-8362-4c6336247d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:06.714860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d34447-1b75-45d4-8362-4c6336247d82 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:06.715143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d34447-1b75-45d4-8362-4c6336247d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:06.715420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d34447-1b75-45d4-8362-4c6336247d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:06.777571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:06.785263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d34447-1b75-45d4-8362-4c6336247d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:06.786732 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d34447-1b75-45d4-8362-4c6336247d82 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:06.884614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 579/1159] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:02:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:02:06.890620 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5109b5c-1e94-4193-b375-23792b07e788 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:06.992895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5109b5c-1e94-4193-b375-23792b07e788 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:07.033850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25ff17-5c3e-4770-9641-90a981af5ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:07.035090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25ff17-5c3e-4770-9641-90a981af5ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:07.035535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25ff17-5c3e-4770-9641-90a981af5ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:07.035824 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25ff17-5c3e-4770-9641-90a981af5ba9 None admin] PATH_INFO: `/v3/projects/9c9669f167fb490abf325daf723471c8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:07.036998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25ff17-5c3e-4770-9641-90a981af5ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=9c9669f167fb490abf325daf723471c8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:07.038473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25ff17-5c3e-4770-9641-90a981af5ba9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:07.040169 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 581/1160] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:02:06 2022] GET /identity/v3/projects/9c9669f167fb490abf325daf723471c8 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:07.046489 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d34447-1b75-45d4-8362-4c6336247d82 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:07.139625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:07.146862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d34447-1b75-45d4-8362-4c6336247d82 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:07.180610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8264b-4e5b-4336-a0f8-df97f6fb0a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:07.181255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8264b-4e5b-4336-a0f8-df97f6fb0a7b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:07.181567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8264b-4e5b-4336-a0f8-df97f6fb0a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:07.181846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8264b-4e5b-4336-a0f8-df97f6fb0a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:07.182677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8264b-4e5b-4336-a0f8-df97f6fb0a7b None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=9c9669f167fb490abf325daf723471c8, user.id=e669416906884990a60a80e3f7c3d1d5) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:07.182988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8264b-4e5b-4336-a0f8-df97f6fb0a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:07.184410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8264b-4e5b-4336-a0f8-df97f6fb0a7b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:07.190128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 580/1161] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:02:07 2022] GET /identity/v3/role_assignments?user.id=e669416906884990a60a80e3f7c3d1d5&scope.project.id=9c9669f167fb490abf325daf723471c8&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:02:09.237456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617902c-2ce7-4285-a6c1-2ab8a4bcc425 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:09.238023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617902c-2ce7-4285-a6c1-2ab8a4bcc425 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:09.238023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617902c-2ce7-4285-a6c1-2ab8a4bcc425 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:09.239395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 582/1162] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:02:09.244720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe7f48-5293-4574-b834-e38166ca7882 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:09.245145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe7f48-5293-4574-b834-e38166ca7882 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:09.245259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe7f48-5293-4574-b834-e38166ca7882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:09.261851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-18fe7f48-5293-4574-b834-e38166ca7882 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:02:09.263005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-18fe7f48-5293-4574-b834-e38166ca7882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:02:09.327322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 581/1163] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:02:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:02:09.350141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617902c-2ce7-4285-a6c1-2ab8a4bcc425 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:09.380441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:09.451924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617902c-2ce7-4285-a6c1-2ab8a4bcc425 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:09.485205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5a276-debd-49a4-b21c-d923a8e4e11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:09.485862 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5a276-debd-49a4-b21c-d923a8e4e11c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:09.486145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5a276-debd-49a4-b21c-d923a8e4e11c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:09.486422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5a276-debd-49a4-b21c-d923a8e4e11c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:09.551263 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5a276-debd-49a4-b21c-d923a8e4e11c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:09.552616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5a276-debd-49a4-b21c-d923a8e4e11c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:09.581634 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:09.647863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 583/1164] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:02:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:02:09.654023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe7f48-5293-4574-b834-e38166ca7882 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:09.740436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:09.753617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe7f48-5293-4574-b834-e38166ca7882 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:09.786020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f32e3-1595-46c0-b487-0890f1ccb012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:09.786808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f32e3-1595-46c0-b487-0890f1ccb012 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:09.787089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f32e3-1595-46c0-b487-0890f1ccb012 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:09.787362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f32e3-1595-46c0-b487-0890f1ccb012 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:09.794594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f32e3-1595-46c0-b487-0890f1ccb012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:09.796015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f32e3-1595-46c0-b487-0890f1ccb012 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-130f32e3-1595-46c0-b487-0890f1ccb012 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:02:09.810498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:02:09.811803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:02:09.812876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 582/1165] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:02:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:02:09.817618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5a276-debd-49a4-b21c-d923a8e4e11c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:09.916522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5a276-debd-49a4-b21c-d923a8e4e11c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:09.945047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:09.950405 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac95f2-46c6-40a6-9a2a-5058ae14740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:09.951056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac95f2-46c6-40a6-9a2a-5058ae14740e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:09.951337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac95f2-46c6-40a6-9a2a-5058ae14740e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:09.951613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac95f2-46c6-40a6-9a2a-5058ae14740e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:09.952318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac95f2-46c6-40a6-9a2a-5058ae14740e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:09.952622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac95f2-46c6-40a6-9a2a-5058ae14740e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:09.954019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac95f2-46c6-40a6-9a2a-5058ae14740e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:09.961627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 584/1166] 10.222.0.90 () {56 vars in 1115 bytes} [Tue Jun 21 15:02:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:11.966199 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007f78-b67c-4fdf-984c-9553f0edf45d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:11.966726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007f78-b67c-4fdf-984c-9553f0edf45d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:11.966822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007f78-b67c-4fdf-984c-9553f0edf45d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:11.968121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 583/1167] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:02:11.973329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340fa3-c8b0-4ee7-b29e-e4c840714c74 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:11.973741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340fa3-c8b0-4ee7-b29e-e4c840714c74 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:11.973931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340fa3-c8b0-4ee7-b29e-e4c840714c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:11.995560 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-15340fa3-c8b0-4ee7-b29e-e4c840714c74 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:02:11.996735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-15340fa3-c8b0-4ee7-b29e-e4c840714c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:02:12.065196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 585/1168] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:02:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:02:12.088693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3007f78-b67c-4fdf-984c-9553f0edf45d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:12.197425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3007f78-b67c-4fdf-984c-9553f0edf45d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:12.236143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e2f32-0093-49e9-b6e6-cc5e8c0c9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:12.236794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e2f32-0093-49e9-b6e6-cc5e8c0c9db1 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:12.237078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e2f32-0093-49e9-b6e6-cc5e8c0c9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:12.237353 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e2f32-0093-49e9-b6e6-cc5e8c0c9db1 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:12.238118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e2f32-0093-49e9-b6e6-cc5e8c0c9db1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:12.239482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e2f32-0093-49e9-b6e6-cc5e8c0c9db1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:12.255048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 584/1169] 10.222.0.90 () {60 vars in 1138 bytes} [Tue Jun 21 15:02:12 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:02:14.303292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58ae7c-6cf5-4389-817b-6b95ea784f4f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:14.303973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58ae7c-6cf5-4389-817b-6b95ea784f4f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:14.303973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58ae7c-6cf5-4389-817b-6b95ea784f4f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:14.305302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 586/1170] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:02:14.310627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a96832-729e-4cd1-aedb-328f873d8877 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:14.311006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a96832-729e-4cd1-aedb-328f873d8877 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:14.311201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a96832-729e-4cd1-aedb-328f873d8877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:14.329012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-86a96832-729e-4cd1-aedb-328f873d8877 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:02:14.330226 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86a96832-729e-4cd1-aedb-328f873d8877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:02:14.332159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:14.399187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 585/1171] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:02:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:02:14.423366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58ae7c-6cf5-4389-817b-6b95ea784f4f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:14.524685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58ae7c-6cf5-4389-817b-6b95ea784f4f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:14.549959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:14.559496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed45ab-cc5c-48b0-9495-519d37668396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:14.560281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed45ab-cc5c-48b0-9495-519d37668396 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:14.560566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed45ab-cc5c-48b0-9495-519d37668396 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:14.560844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed45ab-cc5c-48b0-9495-519d37668396 None admin] PATH_INFO: `/v3/domains/826b09738d3448c4ab8cf0a9fb0a16c9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:14.571666 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed45ab-cc5c-48b0-9495-519d37668396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=826b09738d3448c4ab8cf0a9fb0a16c9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:14.573127 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed45ab-cc5c-48b0-9495-519d37668396 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:14.574778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 587/1172] 10.222.0.90 () {56 vars in 1183 bytes} [Tue Jun 21 15:02:14 2022] GET /identity/v3/domains/826b09738d3448c4ab8cf0a9fb0a16c9 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:14.580692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a96832-729e-4cd1-aedb-328f873d8877 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:14.676867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a96832-729e-4cd1-aedb-328f873d8877 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:14.710276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaac9c-a4ff-4fbb-a198-38640a88e0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:14.711134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaac9c-a4ff-4fbb-a198-38640a88e0b2 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:14.711341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaac9c-a4ff-4fbb-a198-38640a88e0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:14.711618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaac9c-a4ff-4fbb-a198-38640a88e0b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:14.712309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaac9c-a4ff-4fbb-a198-38640a88e0b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:14.713753 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaac9c-a4ff-4fbb-a198-38640a88e0b2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:14.721363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:14.738354 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 586/1173] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:02:14 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:02:16.806029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db44f39-ac81-412d-bb9e-77109a6f8d4c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:16.806559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db44f39-ac81-412d-bb9e-77109a6f8d4c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:16.806653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db44f39-ac81-412d-bb9e-77109a6f8d4c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:16.808049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 588/1174] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:02:16.813293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a712-c382-45d1-a0f0-a70a73a43f8f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:16.813748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a712-c382-45d1-a0f0-a70a73a43f8f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:16.813891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a712-c382-45d1-a0f0-a70a73a43f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:16.831620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bce1a712-c382-45d1-a0f0-a70a73a43f8f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:02:16.832794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bce1a712-c382-45d1-a0f0-a70a73a43f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:02:16.899275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 587/1175] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:02:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:02:16.924880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db44f39-ac81-412d-bb9e-77109a6f8d4c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:17.025339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db44f39-ac81-412d-bb9e-77109a6f8d4c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:17.057698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9953c4-d1cb-4be9-b3dc-70e078ac1d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:17.058481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9953c4-d1cb-4be9-b3dc-70e078ac1d4f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:17.058760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9953c4-d1cb-4be9-b3dc-70e078ac1d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:17.059034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9953c4-d1cb-4be9-b3dc-70e078ac1d4f None admin] PATH_INFO: `/v3/domains/826b09738d3448c4ab8cf0a9fb0a16c9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:17.060185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9953c4-d1cb-4be9-b3dc-70e078ac1d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=826b09738d3448c4ab8cf0a9fb0a16c9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:17.061635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9953c4-d1cb-4be9-b3dc-70e078ac1d4f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:17.063214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 589/1176] 10.222.0.90 () {56 vars in 1183 bytes} [Tue Jun 21 15:02:16 2022] GET /identity/v3/domains/826b09738d3448c4ab8cf0a9fb0a16c9 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:17.068927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a712-c382-45d1-a0f0-a70a73a43f8f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:17.166904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a712-c382-45d1-a0f0-a70a73a43f8f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:17.187464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:17.202155 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d058e26-a9d4-4128-ade1-c03ab1129a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:17.202820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d058e26-a9d4-4128-ade1-c03ab1129a3a None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:17.203108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d058e26-a9d4-4128-ade1-c03ab1129a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:17.203387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d058e26-a9d4-4128-ade1-c03ab1129a3a None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:17.204108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d058e26-a9d4-4128-ade1-c03ab1129a3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:17.205563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d058e26-a9d4-4128-ade1-c03ab1129a3a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:17.225313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 588/1177] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:02:17 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:02:19.385693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d87d-1427-4ffc-8170-49d839e365b8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:19.386228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d87d-1427-4ffc-8170-49d839e365b8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:19.386228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d87d-1427-4ffc-8170-49d839e365b8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:19.387597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 590/1178] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:02:19.393071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b6ff-5510-470f-9dc9-e2e7a0a6e013 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:19.393518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b6ff-5510-470f-9dc9-e2e7a0a6e013 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:19.393693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b6ff-5510-470f-9dc9-e2e7a0a6e013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:19.410353 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0962b6ff-5510-470f-9dc9-e2e7a0a6e013 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:02:19.411570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0962b6ff-5510-470f-9dc9-e2e7a0a6e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:02:19.478494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 589/1179] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:02:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:02:19.503627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439d87d-1427-4ffc-8170-49d839e365b8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:19.563923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:19.612410 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439d87d-1427-4ffc-8170-49d839e365b8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:19.651029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e5446-383b-4a65-831d-499183eee09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:19.651739 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e5446-383b-4a65-831d-499183eee09a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:19.652038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e5446-383b-4a65-831d-499183eee09a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:19.652308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e5446-383b-4a65-831d-499183eee09a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:19.663310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e5446-383b-4a65-831d-499183eee09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9b1e5446-383b-4a65-831d-499183eee09a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:02:19.672699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:02:19.673906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:02:19.674876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 591/1180] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:02:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:02:19.680526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b6ff-5510-470f-9dc9-e2e7a0a6e013 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:19.782785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b6ff-5510-470f-9dc9-e2e7a0a6e013 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:19.791444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:19.819283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9801b08-3cf5-4e0c-9571-b929246e5cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:19.820010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801b08-3cf5-4e0c-9571-b929246e5cfb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:19.820518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801b08-3cf5-4e0c-9571-b929246e5cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:19.820868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801b08-3cf5-4e0c-9571-b929246e5cfb None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:19.821652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9801b08-3cf5-4e0c-9571-b929246e5cfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:19.821972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9801b08-3cf5-4e0c-9571-b929246e5cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:19.823350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9801b08-3cf5-4e0c-9571-b929246e5cfb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:19.831794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 590/1181] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:19.838557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e5446-383b-4a65-831d-499183eee09a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:19.948121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e5446-383b-4a65-831d-499183eee09a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:19.964389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:19.986150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa05a3-2104-40a5-acd7-80f586e992ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:19.987031 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa05a3-2104-40a5-acd7-80f586e992ff None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:19.987319 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa05a3-2104-40a5-acd7-80f586e992ff None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:19.987597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa05a3-2104-40a5-acd7-80f586e992ff None admin] PATH_INFO: `/v3/users/84a1876668b64fb3857a09125d01b3d6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:20.001899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa05a3-2104-40a5-acd7-80f586e992ff None admin] RBAC: Authorizing `identity:get_user(user_id=84a1876668b64fb3857a09125d01b3d6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:20.003350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa05a3-2104-40a5-acd7-80f586e992ff None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:20.005026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 592/1182] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:02:19 2022] GET /identity/v3/users/84a1876668b64fb3857a09125d01b3d6 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:20.011532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9801b08-3cf5-4e0c-9571-b929246e5cfb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:20.113939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9801b08-3cf5-4e0c-9571-b929246e5cfb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:20.148785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381e91-9634-4e2b-a7fb-08f93a98ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:20.149697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381e91-9634-4e2b-a7fb-08f93a98ee6d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:20.149984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381e91-9634-4e2b-a7fb-08f93a98ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:20.150264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381e91-9634-4e2b-a7fb-08f93a98ee6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:20.184526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:20.220925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce381e91-9634-4e2b-a7fb-08f93a98ee6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:20.222390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce381e91-9634-4e2b-a7fb-08f93a98ee6d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:20.321833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 591/1183] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:02:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:02:20.327696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa05a3-2104-40a5-acd7-80f586e992ff None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:20.428640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa05a3-2104-40a5-acd7-80f586e992ff None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:20.462023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad28414-606b-49f1-bd6f-2dabfdab8a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:20.462860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad28414-606b-49f1-bd6f-2dabfdab8a85 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:20.463142 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad28414-606b-49f1-bd6f-2dabfdab8a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:20.463417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad28414-606b-49f1-bd6f-2dabfdab8a85 None admin] PATH_INFO: `/v3/projects/093b50831e334c47976703e32304166c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:20.464584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad28414-606b-49f1-bd6f-2dabfdab8a85 None admin] RBAC: Authorizing `identity:get_project(project_id=093b50831e334c47976703e32304166c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:20.466044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad28414-606b-49f1-bd6f-2dabfdab8a85 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:20.467711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 593/1184] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:02:20 2022] GET /identity/v3/projects/093b50831e334c47976703e32304166c => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:20.473837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381e91-9634-4e2b-a7fb-08f93a98ee6d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:20.541266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:20.590754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381e91-9634-4e2b-a7fb-08f93a98ee6d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:20.633902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119e5a6-13a9-49c9-934e-fb98d23e398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:20.634638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e5a6-13a9-49c9-934e-fb98d23e398f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:20.634920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e5a6-13a9-49c9-934e-fb98d23e398f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:20.635204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e5a6-13a9-49c9-934e-fb98d23e398f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:20.636042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119e5a6-13a9-49c9-934e-fb98d23e398f None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=093b50831e334c47976703e32304166c, user.id=84a1876668b64fb3857a09125d01b3d6) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:20.636364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119e5a6-13a9-49c9-934e-fb98d23e398f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:20.637832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119e5a6-13a9-49c9-934e-fb98d23e398f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:20.643505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 592/1185] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:02:20 2022] GET /identity/v3/role_assignments?user.id=84a1876668b64fb3857a09125d01b3d6&scope.project.id=093b50831e334c47976703e32304166c&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:22.723054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f5743-ab61-4fca-9ed5-19b67ae0e96e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:22.723594 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f5743-ab61-4fca-9ed5-19b67ae0e96e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:22.723594 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f5743-ab61-4fca-9ed5-19b67ae0e96e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:22.724960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 594/1186] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:02:22.730713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd433c-9492-453b-b9fb-83d7ada77d19 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:22.731214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd433c-9492-453b-b9fb-83d7ada77d19 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:22.731319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd433c-9492-453b-b9fb-83d7ada77d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:22.748621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0dcd433c-9492-453b-b9fb-83d7ada77d19 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:02:22.749846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0dcd433c-9492-453b-b9fb-83d7ada77d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:02:22.816693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 593/1187] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:02:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:02:22.840298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f5743-ab61-4fca-9ed5-19b67ae0e96e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:22.886683 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:22.957865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f5743-ab61-4fca-9ed5-19b67ae0e96e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:22.994027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2fb45-0acb-4195-ba65-653585866c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:22.994714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2fb45-0acb-4195-ba65-653585866c8f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:22.994997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2fb45-0acb-4195-ba65-653585866c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:22.995273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2fb45-0acb-4195-ba65-653585866c8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:23.005084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2fb45-0acb-4195-ba65-653585866c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5ba2fb45-0acb-4195-ba65-653585866c8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:02:23.013490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:02:23.014635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:02:23.015722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 595/1188] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:02:23.020765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd433c-9492-453b-b9fb-83d7ada77d19 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:23.081554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:23.121711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd433c-9492-453b-b9fb-83d7ada77d19 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:23.154778 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e5c9-8979-4c4a-8ae0-5188321cb0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:23.155445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e5c9-8979-4c4a-8ae0-5188321cb0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:23.155761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e5c9-8979-4c4a-8ae0-5188321cb0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:23.156067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e5c9-8979-4c4a-8ae0-5188321cb0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:23.156864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399e5c9-8979-4c4a-8ae0-5188321cb0f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:23.157242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399e5c9-8979-4c4a-8ae0-5188321cb0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:23.158834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399e5c9-8979-4c4a-8ae0-5188321cb0f4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:23.167748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 594/1189] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:23.173570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2fb45-0acb-4195-ba65-653585866c8f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:23.270643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:23.273817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2fb45-0acb-4195-ba65-653585866c8f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:23.308533 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece72f79-9ef9-4526-9730-587410a9f433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:23.309389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece72f79-9ef9-4526-9730-587410a9f433 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:23.309706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece72f79-9ef9-4526-9730-587410a9f433 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:23.309986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece72f79-9ef9-4526-9730-587410a9f433 None admin] PATH_INFO: `/v3/users/84a1876668b64fb3857a09125d01b3d6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:23.311160 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece72f79-9ef9-4526-9730-587410a9f433 None admin] RBAC: Authorizing `identity:get_user(user_id=84a1876668b64fb3857a09125d01b3d6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:23.312589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece72f79-9ef9-4526-9730-587410a9f433 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:23.314247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 596/1190] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:02:23 2022] GET /identity/v3/users/84a1876668b64fb3857a09125d01b3d6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:23.320208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e5c9-8979-4c4a-8ae0-5188321cb0f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:23.422096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e5c9-8979-4c4a-8ae0-5188321cb0f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:23.444043 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:23.454973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde3143-02f4-4599-8f29-0774d7923bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:23.455822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde3143-02f4-4599-8f29-0774d7923bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:23.456103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde3143-02f4-4599-8f29-0774d7923bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:23.456376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde3143-02f4-4599-8f29-0774d7923bc3 None admin] PATH_INFO: `/v3/projects/093b50831e334c47976703e32304166c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:23.457545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde3143-02f4-4599-8f29-0774d7923bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=093b50831e334c47976703e32304166c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:23.458968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde3143-02f4-4599-8f29-0774d7923bc3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:23.461293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 595/1191] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:02:23 2022] GET /identity/v3/projects/093b50831e334c47976703e32304166c => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:23.467495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece72f79-9ef9-4526-9730-587410a9f433 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:23.568225 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece72f79-9ef9-4526-9730-587410a9f433 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:23.602798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032aee4-843a-4899-828a-1d0aaeadc450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:23.603688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032aee4-843a-4899-828a-1d0aaeadc450 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:23.603972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032aee4-843a-4899-828a-1d0aaeadc450 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:23.604252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032aee4-843a-4899-828a-1d0aaeadc450 None admin] PATH_INFO: `/v3/projects/093b50831e334c47976703e32304166c/users/84a1876668b64fb3857a09125d01b3d6/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:23.606286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032aee4-843a-4899-828a-1d0aaeadc450 None admin] RBAC: Authorizing `identity:create_grant(project_id=093b50831e334c47976703e32304166c, user_id=84a1876668b64fb3857a09125d01b3d6, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:23.607724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032aee4-843a-4899-828a-1d0aaeadc450 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:23.621118 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 597/1192] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:02:23 2022] PUT /identity/v3/projects/093b50831e334c47976703e32304166c/users/84a1876668b64fb3857a09125d01b3d6/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:02:25.713045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20da95f-b6f5-402d-923a-f88ea05c3700 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:25.713619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20da95f-b6f5-402d-923a-f88ea05c3700 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:25.713744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20da95f-b6f5-402d-923a-f88ea05c3700 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:25.715018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 596/1193] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:02:25.720397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5bf3e-8274-45e0-bf38-f30f24043ede None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:25.720828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5bf3e-8274-45e0-bf38-f30f24043ede None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:25.720953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5bf3e-8274-45e0-bf38-f30f24043ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:25.743442 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2cb5bf3e-8274-45e0-bf38-f30f24043ede None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:02:25.744647 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2cb5bf3e-8274-45e0-bf38-f30f24043ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:02:25.768312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:25.813574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 598/1194] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:02:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:02:25.838203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20da95f-b6f5-402d-923a-f88ea05c3700 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:25.938844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20da95f-b6f5-402d-923a-f88ea05c3700 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:25.984562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6a21-4502-469d-9974-422f5b9c07b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:25.985272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6a21-4502-469d-9974-422f5b9c07b8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:25.986134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6a21-4502-469d-9974-422f5b9c07b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:25.988090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6a21-4502-469d-9974-422f5b9c07b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:26.002288 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a6a21-4502-469d-9974-422f5b9c07b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6f3a6a21-4502-469d-9974-422f5b9c07b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:02:26.011549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:02:26.013498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:02:26.014572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 597/1195] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:02:26.018871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5bf3e-8274-45e0-bf38-f30f24043ede None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:26.123305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5bf3e-8274-45e0-bf38-f30f24043ede None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:26.156434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3edb6-669d-4f20-b4d5-e115ca73691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:26.157089 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3edb6-669d-4f20-b4d5-e115ca73691f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:26.157369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3edb6-669d-4f20-b4d5-e115ca73691f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:26.157674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3edb6-669d-4f20-b4d5-e115ca73691f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:26.158416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3edb6-669d-4f20-b4d5-e115ca73691f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:26.158723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3edb6-669d-4f20-b4d5-e115ca73691f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:26.160080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3edb6-669d-4f20-b4d5-e115ca73691f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:26.168839 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 599/1196] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:26.174620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6a21-4502-469d-9974-422f5b9c07b8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:26.228791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:26.274368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6a21-4502-469d-9974-422f5b9c07b8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:26.312279 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6281df-861b-4ebb-b135-5b6637f1ce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:26.313465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6281df-861b-4ebb-b135-5b6637f1ce35 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:26.313777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6281df-861b-4ebb-b135-5b6637f1ce35 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:26.314045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6281df-861b-4ebb-b135-5b6637f1ce35 None admin] PATH_INFO: `/v3/users/84a1876668b64fb3857a09125d01b3d6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:26.315287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6281df-861b-4ebb-b135-5b6637f1ce35 None admin] RBAC: Authorizing `identity:get_user(user_id=84a1876668b64fb3857a09125d01b3d6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:26.316733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6281df-861b-4ebb-b135-5b6637f1ce35 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:26.318576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 598/1197] 10.222.0.90 () {56 vars in 1177 bytes} [Tue Jun 21 15:02:26 2022] GET /identity/v3/users/84a1876668b64fb3857a09125d01b3d6 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:26.324701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3edb6-669d-4f20-b4d5-e115ca73691f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:26.349223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:26.439274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3edb6-669d-4f20-b4d5-e115ca73691f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:26.477488 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7236-16aa-49ff-884d-3c9274f83dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:26.478152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7236-16aa-49ff-884d-3c9274f83dce None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:26.478488 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7236-16aa-49ff-884d-3c9274f83dce None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:26.478792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f7236-16aa-49ff-884d-3c9274f83dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:26.552932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f7236-16aa-49ff-884d-3c9274f83dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:26.554906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f7236-16aa-49ff-884d-3c9274f83dce None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:26.575784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:26.655595 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 600/1198] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:02:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:02:26.661589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6281df-861b-4ebb-b135-5b6637f1ce35 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:26.759684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6281df-861b-4ebb-b135-5b6637f1ce35 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:26.780776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:26.795488 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556b08c-b521-42fe-bd03-50e46fc31436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:26.796338 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b08c-b521-42fe-bd03-50e46fc31436 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:26.796621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b08c-b521-42fe-bd03-50e46fc31436 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:26.796898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b08c-b521-42fe-bd03-50e46fc31436 None admin] PATH_INFO: `/v3/projects/093b50831e334c47976703e32304166c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:26.798081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556b08c-b521-42fe-bd03-50e46fc31436 None admin] RBAC: Authorizing `identity:get_project(project_id=093b50831e334c47976703e32304166c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:26.799504 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556b08c-b521-42fe-bd03-50e46fc31436 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:26.801186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 599/1199] 10.222.0.90 () {56 vars in 1186 bytes} [Tue Jun 21 15:02:26 2022] GET /identity/v3/projects/093b50831e334c47976703e32304166c => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:26.807889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7236-16aa-49ff-884d-3c9274f83dce None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:02:26.905347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f7236-16aa-49ff-884d-3c9274f83dce None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:02:26.925423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:26.941756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76607e-f3f2-4faa-a3c1-6671fd7c4653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:02:26.942410 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76607e-f3f2-4faa-a3c1-6671fd7c4653 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:02:26.942695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76607e-f3f2-4faa-a3c1-6671fd7c4653 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:02:26.942973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76607e-f3f2-4faa-a3c1-6671fd7c4653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:02:26.943796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76607e-f3f2-4faa-a3c1-6671fd7c4653 None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=093b50831e334c47976703e32304166c, user.id=84a1876668b64fb3857a09125d01b3d6) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:02:26.944109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76607e-f3f2-4faa-a3c1-6671fd7c4653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:02:26.946163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76607e-f3f2-4faa-a3c1-6671fd7c4653 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:02:26.952000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 601/1200] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:02:26 2022] GET /identity/v3/role_assignments?user.id=84a1876668b64fb3857a09125d01b3d6&scope.project.id=093b50831e334c47976703e32304166c&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:02:36.791335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:02:36.949886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=8 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:24.658620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a4293-789c-4964-b0d8-a88ac7aa56a3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:24.660802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a4293-789c-4964-b0d8-a88ac7aa56a3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:24.660802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a4293-789c-4964-b0d8-a88ac7aa56a3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:24.662800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 600/1201] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:03:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:03:24.668703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5607e0-adc6-4922-8daf-540b60adb266 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:24.669374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5607e0-adc6-4922-8daf-540b60adb266 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:24.669374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5607e0-adc6-4922-8daf-540b60adb266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:24.692667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9d5607e0-adc6-4922-8daf-540b60adb266 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:03:24.694818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9d5607e0-adc6-4922-8daf-540b60adb266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:03:24.788050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 602/1202] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:03:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:03:24.815585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a4293-789c-4964-b0d8-a88ac7aa56a3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:24.959282 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a4293-789c-4964-b0d8-a88ac7aa56a3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:25.007404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d25f2b-c5e7-4358-b56f-0bc08600da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:25.011757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d25f2b-c5e7-4358-b56f-0bc08600da30 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:25.011757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d25f2b-c5e7-4358-b56f-0bc08600da30 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:25.011757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d25f2b-c5e7-4358-b56f-0bc08600da30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:25.026904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d25f2b-c5e7-4358-b56f-0bc08600da30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:25.028363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d25f2b-c5e7-4358-b56f-0bc08600da30 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f7d25f2b-c5e7-4358-b56f-0bc08600da30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:25.053023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:25.054827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:25.056551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:25.056551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:25.056551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:25.056551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:25.056551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 601/1203] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:25.063060 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5607e0-adc6-4922-8daf-540b60adb266 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:25.219462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5607e0-adc6-4922-8daf-540b60adb266 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:25.263728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:25.270462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bc80a-f6eb-4b4c-8cbb-f550e2e5606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:25.272080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bc80a-f6eb-4b4c-8cbb-f550e2e5606b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:25.272460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bc80a-f6eb-4b4c-8cbb-f550e2e5606b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:25.272804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bc80a-f6eb-4b4c-8cbb-f550e2e5606b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:25.273793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bc80a-f6eb-4b4c-8cbb-f550e2e5606b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:25.274123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bc80a-f6eb-4b4c-8cbb-f550e2e5606b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:25.275916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bc80a-f6eb-4b4c-8cbb-f550e2e5606b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:25.293108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 603/1204] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:25.301464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d25f2b-c5e7-4358-b56f-0bc08600da30 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:25.385374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:25.452538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d25f2b-c5e7-4358-b56f-0bc08600da30 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:25.501564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e6b5c-c2c2-4455-ae2d-e5b4986296d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:25.502215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e6b5c-c2c2-4455-ae2d-e5b4986296d2 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:25.502527 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e6b5c-c2c2-4455-ae2d-e5b4986296d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:25.502829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e6b5c-c2c2-4455-ae2d-e5b4986296d2 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:25.503668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e6b5c-c2c2-4455-ae2d-e5b4986296d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:25.506092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e6b5c-c2c2-4455-ae2d-e5b4986296d2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:25.529900 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 602/1205] 10.222.0.90 () {60 vars in 1132 bytes} [Tue Jun 21 15:03:25 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:03:27.940705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed10984-53fc-4d2a-bfdb-ef183ff977ad None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:27.941217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed10984-53fc-4d2a-bfdb-ef183ff977ad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:27.941308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed10984-53fc-4d2a-bfdb-ef183ff977ad None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:27.943508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 604/1206] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:03:27.949388 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79b32-cce0-4a58-9149-3e3bd5e8854c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:27.949888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79b32-cce0-4a58-9149-3e3bd5e8854c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:27.950000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79b32-cce0-4a58-9149-3e3bd5e8854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:27.968288 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-16a79b32-cce0-4a58-9149-3e3bd5e8854c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:03:27.969690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-16a79b32-cce0-4a58-9149-3e3bd5e8854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:03:28.054112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 603/1207] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:03:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:03:28.082072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed10984-53fc-4d2a-bfdb-ef183ff977ad None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:28.251710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed10984-53fc-4d2a-bfdb-ef183ff977ad None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:28.296668 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b088-7c1c-41ca-abe7-bbd319e9e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:28.297924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b088-7c1c-41ca-abe7-bbd319e9e7ac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:28.297924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b088-7c1c-41ca-abe7-bbd319e9e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:28.298212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b088-7c1c-41ca-abe7-bbd319e9e7ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:28.312439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4b088-7c1c-41ca-abe7-bbd319e9e7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0ba4b088-7c1c-41ca-abe7-bbd319e9e7ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:03:28.321366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:28.322470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:28.323354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 605/1208] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:03:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:28.329106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79b32-cce0-4a58-9149-3e3bd5e8854c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:28.381250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:28.461082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79b32-cce0-4a58-9149-3e3bd5e8854c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:28.509572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ded52-9a81-43c3-aa85-39be9e1cfe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:28.510189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ded52-9a81-43c3-aa85-39be9e1cfe0c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:28.510487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ded52-9a81-43c3-aa85-39be9e1cfe0c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:28.510786 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ded52-9a81-43c3-aa85-39be9e1cfe0c None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:28.511605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ded52-9a81-43c3-aa85-39be9e1cfe0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:28.511971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ded52-9a81-43c3-aa85-39be9e1cfe0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:28.513530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ded52-9a81-43c3-aa85-39be9e1cfe0c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:28.526685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 604/1209] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:03:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:28.534099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b088-7c1c-41ca-abe7-bbd319e9e7ac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:28.602937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:28.681517 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b088-7c1c-41ca-abe7-bbd319e9e7ac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:28.740704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a5a53-d165-4685-b26b-0658f4942dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:28.741713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5a53-d165-4685-b26b-0658f4942dab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:28.741999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5a53-d165-4685-b26b-0658f4942dab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:28.742465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a5a53-d165-4685-b26b-0658f4942dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:28.759246 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a5a53-d165-4685-b26b-0658f4942dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:28.760809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a5a53-d165-4685-b26b-0658f4942dab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-dd3a5a53-d165-4685-b26b-0658f4942dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:28.782806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:28.784179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:28.785138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:28.785138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:28.785138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:28.785138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:28.788279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 606/1210] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:28.796355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ded52-9a81-43c3-aa85-39be9e1cfe0c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:28.922897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:28.927563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ded52-9a81-43c3-aa85-39be9e1cfe0c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:28.975269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d71b3-3c2c-4ce9-8230-a1534ecf18a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:28.976052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d71b3-3c2c-4ce9-8230-a1534ecf18a5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:28.977135 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d71b3-3c2c-4ce9-8230-a1534ecf18a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:28.977135 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d71b3-3c2c-4ce9-8230-a1534ecf18a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:28.977428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d71b3-3c2c-4ce9-8230-a1534ecf18a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:28.977770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d71b3-3c2c-4ce9-8230-a1534ecf18a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:28.979341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d71b3-3c2c-4ce9-8230-a1534ecf18a5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:29.000132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 605/1211] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:03:29.008225 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a5a53-d165-4685-b26b-0658f4942dab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:29.156686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a5a53-d165-4685-b26b-0658f4942dab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:29.157818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:29.209704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e15e0-9e72-454c-b4a1-1dc54e6857ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:29.210608 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e15e0-9e72-454c-b4a1-1dc54e6857ff None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:29.210988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e15e0-9e72-454c-b4a1-1dc54e6857ff None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:29.211403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e15e0-9e72-454c-b4a1-1dc54e6857ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:29.231690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e15e0-9e72-454c-b4a1-1dc54e6857ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:29.233931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e15e0-9e72-454c-b4a1-1dc54e6857ff None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-356e15e0-9e72-454c-b4a1-1dc54e6857ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:03:29.255436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:29.257296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:29.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 607/1212] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:29.264537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d71b3-3c2c-4ce9-8230-a1534ecf18a5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:29.423705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d71b3-3c2c-4ce9-8230-a1534ecf18a5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:29.483045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8b110-9841-4bf6-915e-2052038bf10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:29.483875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b110-9841-4bf6-915e-2052038bf10c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:29.484205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b110-9841-4bf6-915e-2052038bf10c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:29.484525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b110-9841-4bf6-915e-2052038bf10c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:29.485681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8b110-9841-4bf6-915e-2052038bf10c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:29.487056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8b110-9841-4bf6-915e-2052038bf10c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:29.488030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8b110-9841-4bf6-915e-2052038bf10c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:29.520020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 606/1213] 10.222.0.90 () {56 vars in 1143 bytes} [Tue Jun 21 15:03:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:29.526727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e15e0-9e72-454c-b4a1-1dc54e6857ff None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:29.700101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e15e0-9e72-454c-b4a1-1dc54e6857ff None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:29.747984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f102132-e5dd-4b06-9177-3058ebe69f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:29.748842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f102132-e5dd-4b06-9177-3058ebe69f9f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:29.749201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f102132-e5dd-4b06-9177-3058ebe69f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:29.749631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f102132-e5dd-4b06-9177-3058ebe69f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:29.786934 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:29.834876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f102132-e5dd-4b06-9177-3058ebe69f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:29.836590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f102132-e5dd-4b06-9177-3058ebe69f9f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:29.987318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 608/1214] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:03:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:03:29.994515 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8b110-9841-4bf6-915e-2052038bf10c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:30.018366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:30.121204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8b110-9841-4bf6-915e-2052038bf10c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:30.163013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d03ab7-b4c2-4f06-8f96-89cdd897588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:30.164306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d03ab7-b4c2-4f06-8f96-89cdd897588e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:30.164709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d03ab7-b4c2-4f06-8f96-89cdd897588e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:30.165149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d03ab7-b4c2-4f06-8f96-89cdd897588e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:30.177066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d03ab7-b4c2-4f06-8f96-89cdd897588e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:30.179813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d03ab7-b4c2-4f06-8f96-89cdd897588e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-14d03ab7-b4c2-4f06-8f96-89cdd897588e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:30.202955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:30.204192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:30.205103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:30.205103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:30.205103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:30.205103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:30.209671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 607/1215] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:30.211949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f102132-e5dd-4b06-9177-3058ebe69f9f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:30.286149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:30.335563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f102132-e5dd-4b06-9177-3058ebe69f9f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:30.378143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f44874-f8f5-4269-8001-47ae751eb232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:30.378944 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f44874-f8f5-4269-8001-47ae751eb232 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:30.379325 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f44874-f8f5-4269-8001-47ae751eb232 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:30.379756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f44874-f8f5-4269-8001-47ae751eb232 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:30.381329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f44874-f8f5-4269-8001-47ae751eb232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:30.381701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f44874-f8f5-4269-8001-47ae751eb232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:30.383263 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f44874-f8f5-4269-8001-47ae751eb232 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:30.396946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 609/1216] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:03:30.402963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d03ab7-b4c2-4f06-8f96-89cdd897588e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:30.500567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:30.546465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d03ab7-b4c2-4f06-8f96-89cdd897588e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:30.591908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408468-b578-467e-9d68-6b00ce691fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:30.592787 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408468-b578-467e-9d68-6b00ce691fae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:30.593316 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408468-b578-467e-9d68-6b00ce691fae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:30.593818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408468-b578-467e-9d68-6b00ce691fae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:30.603389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408468-b578-467e-9d68-6b00ce691fae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:30.604902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408468-b578-467e-9d68-6b00ce691fae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-70408468-b578-467e-9d68-6b00ce691fae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:03:30.621668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:30.622754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:30.623752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:03:30.623752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:03:30.623752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:03:30.623752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:03:30.623752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:03:30.623752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:03:30.623752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:30.623752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:30.623752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 608/1217] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:30.630702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f44874-f8f5-4269-8001-47ae751eb232 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:30.781009 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f44874-f8f5-4269-8001-47ae751eb232 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:30.824532 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:30.842369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee00ee-d02a-4dc6-a7d4-edf6a67409f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:30.843282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee00ee-d02a-4dc6-a7d4-edf6a67409f9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:30.843653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee00ee-d02a-4dc6-a7d4-edf6a67409f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:30.844016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee00ee-d02a-4dc6-a7d4-edf6a67409f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:30.845103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee00ee-d02a-4dc6-a7d4-edf6a67409f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:30.845527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee00ee-d02a-4dc6-a7d4-edf6a67409f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:30.847588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee00ee-d02a-4dc6-a7d4-edf6a67409f9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:30.867866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 610/1218] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:30.877137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408468-b578-467e-9d68-6b00ce691fae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:31.015889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408468-b578-467e-9d68-6b00ce691fae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:31.055926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:31.065731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb8bbe-9bbf-4123-8112-108d50836720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:31.066399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb8bbe-9bbf-4123-8112-108d50836720 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:31.066683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb8bbe-9bbf-4123-8112-108d50836720 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:31.066962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb8bbe-9bbf-4123-8112-108d50836720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:31.067954 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb8bbe-9bbf-4123-8112-108d50836720 None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=5e916fba8123451587f5e13568630015) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:31.068391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb8bbe-9bbf-4123-8112-108d50836720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:31.069912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb8bbe-9bbf-4123-8112-108d50836720 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:31.077402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 609/1219] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:03:30 2022] GET /identity/v3/role_assignments?user.id=5e916fba8123451587f5e13568630015&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:33.308477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf9f73-4d40-4da7-a187-770af1f36c95 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:33.309039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf9f73-4d40-4da7-a187-770af1f36c95 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:33.309039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf9f73-4d40-4da7-a187-770af1f36c95 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:33.310420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 611/1220] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:03:33.315576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dfae3-f31f-4008-b51c-6469ece5de77 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:33.316028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dfae3-f31f-4008-b51c-6469ece5de77 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:33.316124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dfae3-f31f-4008-b51c-6469ece5de77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:33.336090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fb6dfae3-f31f-4008-b51c-6469ece5de77 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:03:33.337298 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fb6dfae3-f31f-4008-b51c-6469ece5de77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:03:33.416702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 610/1221] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:03:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:03:33.444874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf9f73-4d40-4da7-a187-770af1f36c95 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:33.573272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf9f73-4d40-4da7-a187-770af1f36c95 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:33.619689 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5e96a-199d-47c5-a50a-947627b48cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:33.620515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5e96a-199d-47c5-a50a-947627b48cab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:33.620805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5e96a-199d-47c5-a50a-947627b48cab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:33.621087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5e96a-199d-47c5-a50a-947627b48cab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:33.633205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5e96a-199d-47c5-a50a-947627b48cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ecb5e96a-199d-47c5-a50a-947627b48cab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:03:33.642609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:33.643910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:33.645133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 612/1222] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:33.650886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dfae3-f31f-4008-b51c-6469ece5de77 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:33.766365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dfae3-f31f-4008-b51c-6469ece5de77 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:33.790411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:33.805666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f573-26cc-4cd0-9b10-5ccfaa2f533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:33.806840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f573-26cc-4cd0-9b10-5ccfaa2f533f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:33.807274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f573-26cc-4cd0-9b10-5ccfaa2f533f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:33.807703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f573-26cc-4cd0-9b10-5ccfaa2f533f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:33.809019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366f573-26cc-4cd0-9b10-5ccfaa2f533f None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:33.809623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366f573-26cc-4cd0-9b10-5ccfaa2f533f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:33.811787 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366f573-26cc-4cd0-9b10-5ccfaa2f533f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:33.821908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 611/1223] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:03:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:33.827933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5e96a-199d-47c5-a50a-947627b48cab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:33.879195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:33.952212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5e96a-199d-47c5-a50a-947627b48cab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:33.993834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d3b7c-1932-4890-ad77-21272a9cef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:33.994629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3b7c-1932-4890-ad77-21272a9cef6e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:33.994915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3b7c-1932-4890-ad77-21272a9cef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:33.995200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3b7c-1932-4890-ad77-21272a9cef6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:34.010490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d3b7c-1932-4890-ad77-21272a9cef6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:34.012468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d3b7c-1932-4890-ad77-21272a9cef6e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-254d3b7c-1932-4890-ad77-21272a9cef6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:34.032063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:34.033399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:34.034607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:34.034607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:34.034607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:34.034607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:34.034607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 613/1224] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:34.043156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f573-26cc-4cd0-9b10-5ccfaa2f533f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:34.162893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f573-26cc-4cd0-9b10-5ccfaa2f533f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:34.203894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1e9f-3739-48e3-b348-acb1149e25e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:34.204598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1e9f-3739-48e3-b348-acb1149e25e9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:34.204926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1e9f-3739-48e3-b348-acb1149e25e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:34.205246 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1e9f-3739-48e3-b348-acb1149e25e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:34.206052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1e9f-3739-48e3-b348-acb1149e25e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:34.206364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1e9f-3739-48e3-b348-acb1149e25e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:34.207967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1e9f-3739-48e3-b348-acb1149e25e9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:34.223372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 612/1225] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:34.230338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d3b7c-1932-4890-ad77-21272a9cef6e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:34.346206 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:34.356382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d3b7c-1932-4890-ad77-21272a9cef6e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:34.394592 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834d437-c81e-4c00-885c-930dac9ad4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:34.395382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d437-c81e-4c00-885c-930dac9ad4ee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:34.396202 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d437-c81e-4c00-885c-930dac9ad4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:34.396504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834d437-c81e-4c00-885c-930dac9ad4ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:34.404989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834d437-c81e-4c00-885c-930dac9ad4ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:34.406507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834d437-c81e-4c00-885c-930dac9ad4ee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7834d437-c81e-4c00-885c-930dac9ad4ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:03:34.422386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:34.425651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:34.426949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 614/1226] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:34.430804 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1e9f-3739-48e3-b348-acb1149e25e9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:34.490264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:34.555268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1e9f-3739-48e3-b348-acb1149e25e9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:34.595544 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39204e-9443-4a17-8fd5-9652f9d7cffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:34.596573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39204e-9443-4a17-8fd5-9652f9d7cffe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:34.596967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39204e-9443-4a17-8fd5-9652f9d7cffe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:34.597296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39204e-9443-4a17-8fd5-9652f9d7cffe None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:34.598283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39204e-9443-4a17-8fd5-9652f9d7cffe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:34.598759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39204e-9443-4a17-8fd5-9652f9d7cffe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:34.601229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39204e-9443-4a17-8fd5-9652f9d7cffe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:34.622495 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 613/1227] 10.222.0.90 () {56 vars in 1143 bytes} [Tue Jun 21 15:03:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:34.628790 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834d437-c81e-4c00-885c-930dac9ad4ee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:34.765253 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834d437-c81e-4c00-885c-930dac9ad4ee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:34.816905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662bac-0be3-4ce0-8ef6-b3328d7b4664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:34.819891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662bac-0be3-4ce0-8ef6-b3328d7b4664 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:34.820185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662bac-0be3-4ce0-8ef6-b3328d7b4664 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:34.820470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662bac-0be3-4ce0-8ef6-b3328d7b4664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:34.838487 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662bac-0be3-4ce0-8ef6-b3328d7b4664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:34.839993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662bac-0be3-4ce0-8ef6-b3328d7b4664 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-27662bac-0be3-4ce0-8ef6-b3328d7b4664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:34.867762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:34.869034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:34.870379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:34.870379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:34.870379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:34.870379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:34.870379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 615/1228] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:34.875778 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39204e-9443-4a17-8fd5-9652f9d7cffe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:34.997779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39204e-9443-4a17-8fd5-9652f9d7cffe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:35.000387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:35.043395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88962ac3-b2bb-4f71-8aaa-fb086398fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:35.044027 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88962ac3-b2bb-4f71-8aaa-fb086398fbdf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:35.044319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88962ac3-b2bb-4f71-8aaa-fb086398fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:35.044592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88962ac3-b2bb-4f71-8aaa-fb086398fbdf None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:35.045628 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88962ac3-b2bb-4f71-8aaa-fb086398fbdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:35.045946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88962ac3-b2bb-4f71-8aaa-fb086398fbdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:35.047436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88962ac3-b2bb-4f71-8aaa-fb086398fbdf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:35.064040 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 614/1229] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:35.070456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662bac-0be3-4ce0-8ef6-b3328d7b4664 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:35.079899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:35.196362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662bac-0be3-4ce0-8ef6-b3328d7b4664 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:35.238903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc34c-adab-4669-ad4b-3c7ce26e6025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:35.240354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc34c-adab-4669-ad4b-3c7ce26e6025 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:35.240782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc34c-adab-4669-ad4b-3c7ce26e6025 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:35.241222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc34c-adab-4669-ad4b-3c7ce26e6025 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:35.252707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc34c-adab-4669-ad4b-3c7ce26e6025 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:35.254704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc34c-adab-4669-ad4b-3c7ce26e6025 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-027cc34c-adab-4669-ad4b-3c7ce26e6025 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:03:35.274268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:35.275510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:35.276801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:03:35.276801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:03:35.276801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:03:35.276801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:03:35.276801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:03:35.276801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:03:35.276801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:35.276801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:35.276801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 616/1230] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:03:35.282210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88962ac3-b2bb-4f71-8aaa-fb086398fbdf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:35.407763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88962ac3-b2bb-4f71-8aaa-fb086398fbdf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:35.456119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2a81a-2bfb-4f4c-bbaf-0f85043fe345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:35.457182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2a81a-2bfb-4f4c-bbaf-0f85043fe345 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:35.457562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2a81a-2bfb-4f4c-bbaf-0f85043fe345 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:35.457899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2a81a-2bfb-4f4c-bbaf-0f85043fe345 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:35.459611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2a81a-2bfb-4f4c-bbaf-0f85043fe345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:35.459938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2a81a-2bfb-4f4c-bbaf-0f85043fe345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:35.461403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2a81a-2bfb-4f4c-bbaf-0f85043fe345 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:35.478362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 615/1231] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:35.484537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc34c-adab-4669-ad4b-3c7ce26e6025 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:35.577974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:35.628184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc34c-adab-4669-ad4b-3c7ce26e6025 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:35.671979 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96f31-f5ec-45f5-8ac1-61462922e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:35.672936 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96f31-f5ec-45f5-8ac1-61462922e5c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:35.673426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96f31-f5ec-45f5-8ac1-61462922e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:35.673736 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96f31-f5ec-45f5-8ac1-61462922e5c5 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/5e916fba8123451587f5e13568630015/roles/ce176ffaea984efb879ec3a4c2da0742` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:35.693602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96f31-f5ec-45f5-8ac1-61462922e5c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=5e916fba8123451587f5e13568630015, role_id=ce176ffaea984efb879ec3a4c2da0742)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:35.695324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96f31-f5ec-45f5-8ac1-61462922e5c5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:35.711927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 617/1232] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:03:35 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/5e916fba8123451587f5e13568630015/roles/ce176ffaea984efb879ec3a4c2da0742 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:03:37.876501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563128e3-de59-46c6-b271-fa489497d716 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:37.877058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563128e3-de59-46c6-b271-fa489497d716 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:37.877058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563128e3-de59-46c6-b271-fa489497d716 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:37.878476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 616/1233] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:03:37.884342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ab946-b2ce-413a-ab10-4126a73690da None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:37.884929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ab946-b2ce-413a-ab10-4126a73690da None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:37.884929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ab946-b2ce-413a-ab10-4126a73690da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:37.901892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b33ab946-b2ce-413a-ab10-4126a73690da None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:03:37.903116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b33ab946-b2ce-413a-ab10-4126a73690da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:03:37.992881 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 618/1234] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:03:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:03:38.018419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563128e3-de59-46c6-b271-fa489497d716 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:38.047752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:38.137359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563128e3-de59-46c6-b271-fa489497d716 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:38.174877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29998-d759-49a5-8595-dda12b708149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:38.177285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29998-d759-49a5-8595-dda12b708149 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:38.177285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29998-d759-49a5-8595-dda12b708149 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:38.177643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29998-d759-49a5-8595-dda12b708149 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:38.189448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad29998-d759-49a5-8595-dda12b708149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2ad29998-d759-49a5-8595-dda12b708149 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:03:38.200158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:38.201236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:38.202181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 617/1235] 10.222.0.90 () {56 vars in 1102 bytes} [Tue Jun 21 15:03:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:38.207524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ab946-b2ce-413a-ab10-4126a73690da None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:38.264162 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:38.333691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ab946-b2ce-413a-ab10-4126a73690da None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:38.384890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a767-0116-4e5c-997e-488a62ed6b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:38.385762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a767-0116-4e5c-997e-488a62ed6b33 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:38.386085 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a767-0116-4e5c-997e-488a62ed6b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:38.386416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a767-0116-4e5c-997e-488a62ed6b33 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:38.387619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45a767-0116-4e5c-997e-488a62ed6b33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:38.387970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45a767-0116-4e5c-997e-488a62ed6b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:38.389385 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45a767-0116-4e5c-997e-488a62ed6b33 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:38.399298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 619/1236] 10.222.0.90 () {56 vars in 1103 bytes} [Tue Jun 21 15:03:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:38.405605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29998-d759-49a5-8595-dda12b708149 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:38.508221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:38.527052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29998-d759-49a5-8595-dda12b708149 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:38.565255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae862-fa59-4069-ad75-9f0d63736096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:38.566149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae862-fa59-4069-ad75-9f0d63736096 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:38.566390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae862-fa59-4069-ad75-9f0d63736096 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:38.566664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae862-fa59-4069-ad75-9f0d63736096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:38.578000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aae862-fa59-4069-ad75-9f0d63736096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:38.579444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aae862-fa59-4069-ad75-9f0d63736096 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f8aae862-fa59-4069-ad75-9f0d63736096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:38.597270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:38.599138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:38.600074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:38.600074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:38.600074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:38.600074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:38.600074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 618/1237] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:38.605387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a767-0116-4e5c-997e-488a62ed6b33 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:38.724994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a767-0116-4e5c-997e-488a62ed6b33 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:38.735369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:38.763068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bccbf-1a29-45fd-8371-0a07e18ce48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:38.763733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bccbf-1a29-45fd-8371-0a07e18ce48e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:38.764018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bccbf-1a29-45fd-8371-0a07e18ce48e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:38.764299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bccbf-1a29-45fd-8371-0a07e18ce48e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:38.765016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bccbf-1a29-45fd-8371-0a07e18ce48e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:38.765334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bccbf-1a29-45fd-8371-0a07e18ce48e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:38.766729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bccbf-1a29-45fd-8371-0a07e18ce48e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:38.781619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 620/1238] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:38.785351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae862-fa59-4069-ad75-9f0d63736096 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:38.906815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae862-fa59-4069-ad75-9f0d63736096 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:38.951180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945880e-9452-4298-b4ba-6106449e0c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:38.951995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945880e-9452-4298-b4ba-6106449e0c05 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:38.952276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945880e-9452-4298-b4ba-6106449e0c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:38.952552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945880e-9452-4298-b4ba-6106449e0c05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:38.957701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:38.962836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945880e-9452-4298-b4ba-6106449e0c05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:38.964339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945880e-9452-4298-b4ba-6106449e0c05 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f945880e-9452-4298-b4ba-6106449e0c05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:03:38.981851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:38.983896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:38.985856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 619/1239] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:38.991735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bccbf-1a29-45fd-8371-0a07e18ce48e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:39.096461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bccbf-1a29-45fd-8371-0a07e18ce48e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:39.132000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c190-e469-40e5-b329-6bec37d182c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:39.132677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c190-e469-40e5-b329-6bec37d182c3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:39.132967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c190-e469-40e5-b329-6bec37d182c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:39.133250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c190-e469-40e5-b329-6bec37d182c3 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:39.134128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10c190-e469-40e5-b329-6bec37d182c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:39.134748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10c190-e469-40e5-b329-6bec37d182c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:39.135869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10c190-e469-40e5-b329-6bec37d182c3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:39.155861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 621/1240] 10.222.0.90 () {56 vars in 1143 bytes} [Tue Jun 21 15:03:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:39.162773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945880e-9452-4298-b4ba-6106449e0c05 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:39.287101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945880e-9452-4298-b4ba-6106449e0c05 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:39.326437 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa5b57-12f3-4717-833d-5d20f019f528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:39.327135 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa5b57-12f3-4717-833d-5d20f019f528 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:39.327424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa5b57-12f3-4717-833d-5d20f019f528 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:39.327716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa5b57-12f3-4717-833d-5d20f019f528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:39.399924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:39.407303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa5b57-12f3-4717-833d-5d20f019f528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:39.408839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa5b57-12f3-4717-833d-5d20f019f528 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:39.532935 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 620/1241] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:03:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:03:39.540311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c190-e469-40e5-b329-6bec37d182c3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:39.576596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:39.658677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c190-e469-40e5-b329-6bec37d182c3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:39.702869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df7c2e-b4a3-4b6b-9a84-f96a4d26d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:39.703766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df7c2e-b4a3-4b6b-9a84-f96a4d26d274 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:39.704160 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df7c2e-b4a3-4b6b-9a84-f96a4d26d274 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:39.704555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df7c2e-b4a3-4b6b-9a84-f96a4d26d274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:39.716913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df7c2e-b4a3-4b6b-9a84-f96a4d26d274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:39.718533 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df7c2e-b4a3-4b6b-9a84-f96a4d26d274 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b6df7c2e-b4a3-4b6b-9a84-f96a4d26d274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:39.741007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:39.742248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:39.743365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:39.743365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:39.743365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:39.743365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:39.743365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 622/1242] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:39.748605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa5b57-12f3-4717-833d-5d20f019f528 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:39.860060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:39.866621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa5b57-12f3-4717-833d-5d20f019f528 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:39.904431 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7fe72-3683-45c0-8072-214cff67ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:39.905550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7fe72-3683-45c0-8072-214cff67ed2d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:39.905853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7fe72-3683-45c0-8072-214cff67ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:39.906134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7fe72-3683-45c0-8072-214cff67ed2d None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:39.906930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7fe72-3683-45c0-8072-214cff67ed2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:39.907586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7fe72-3683-45c0-8072-214cff67ed2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:39.909298 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7fe72-3683-45c0-8072-214cff67ed2d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:39.926314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 621/1243] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:39.934688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df7c2e-b4a3-4b6b-9a84-f96a4d26d274 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:40.033193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:40.058953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df7c2e-b4a3-4b6b-9a84-f96a4d26d274 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:40.105308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5954447-8697-485a-b677-007f2e56d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:40.106139 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5954447-8697-485a-b677-007f2e56d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:40.106425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5954447-8697-485a-b677-007f2e56d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:40.106704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5954447-8697-485a-b677-007f2e56d2a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:40.114404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5954447-8697-485a-b677-007f2e56d2a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:40.115900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5954447-8697-485a-b677-007f2e56d2a7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c5954447-8697-485a-b677-007f2e56d2a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:03:40.133865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:40.135541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:40.137030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:03:40.137030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:03:40.137030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:03:40.137030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:03:40.137030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:03:40.137030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:03:40.137030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:40.137030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:40.139250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 623/1244] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:40.145853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7fe72-3683-45c0-8072-214cff67ed2d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:40.268614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7fe72-3683-45c0-8072-214cff67ed2d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:40.308106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea84400-8c40-470a-bf49-9e6fd9745646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:40.308777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea84400-8c40-470a-bf49-9e6fd9745646 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:40.309068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea84400-8c40-470a-bf49-9e6fd9745646 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:40.309350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea84400-8c40-470a-bf49-9e6fd9745646 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:40.310170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea84400-8c40-470a-bf49-9e6fd9745646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:40.310483 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea84400-8c40-470a-bf49-9e6fd9745646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:40.311908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea84400-8c40-470a-bf49-9e6fd9745646 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:40.329373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 622/1245] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:40.336442 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5954447-8697-485a-b677-007f2e56d2a7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:40.462046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5954447-8697-485a-b677-007f2e56d2a7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:40.501435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dc6ce-869a-49e8-ac92-5cadcf968bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:40.502286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dc6ce-869a-49e8-ac92-5cadcf968bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:40.502592 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dc6ce-869a-49e8-ac92-5cadcf968bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:40.502948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dc6ce-869a-49e8-ac92-5cadcf968bb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:40.503894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dc6ce-869a-49e8-ac92-5cadcf968bb6 None admin] RBAC: Adding query filter params (role.id=ce176ffaea984efb879ec3a4c2da0742, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=5e916fba8123451587f5e13568630015) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:40.504246 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dc6ce-869a-49e8-ac92-5cadcf968bb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:40.506081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dc6ce-869a-49e8-ac92-5cadcf968bb6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:40.512218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 624/1246] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:03:40 2022] GET /identity/v3/role_assignments?user.id=5e916fba8123451587f5e13568630015&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=ce176ffaea984efb879ec3a4c2da0742 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:42.868594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07505b82-4a66-4f0b-8af4-c30ef7238414 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:42.869361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07505b82-4a66-4f0b-8af4-c30ef7238414 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:42.869361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07505b82-4a66-4f0b-8af4-c30ef7238414 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:42.870569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 623/1247] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:03:42.876657 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fbbcc-abf1-4799-87ef-4b630b8fb1d3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:42.877118 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fbbcc-abf1-4799-87ef-4b630b8fb1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:42.877298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fbbcc-abf1-4799-87ef-4b630b8fb1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:42.883902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:42.898660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e84fbbcc-abf1-4799-87ef-4b630b8fb1d3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:03:42.900040 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e84fbbcc-abf1-4799-87ef-4b630b8fb1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:03:42.981212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 625/1248] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:03:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:03:43.006398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07505b82-4a66-4f0b-8af4-c30ef7238414 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:43.027370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:43.128383 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07505b82-4a66-4f0b-8af4-c30ef7238414 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:43.170435 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e9d7-6c66-4b81-92b6-9ec7c4b08937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:43.171247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e9d7-6c66-4b81-92b6-9ec7c4b08937 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:43.171529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e9d7-6c66-4b81-92b6-9ec7c4b08937 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:43.171806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e9d7-6c66-4b81-92b6-9ec7c4b08937 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:43.183784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6e9d7-6c66-4b81-92b6-9ec7c4b08937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1ae6e9d7-6c66-4b81-92b6-9ec7c4b08937 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:03:43.191501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:43.193747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:03:43.194635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:43.198319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 624/1249] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:03:43.199569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fbbcc-abf1-4799-87ef-4b630b8fb1d3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:43.312123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fbbcc-abf1-4799-87ef-4b630b8fb1d3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:43.353306 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:43.362290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5871e-bc97-4b40-aace-2c3788394b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:43.363189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5871e-bc97-4b40-aace-2c3788394b77 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:43.363496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5871e-bc97-4b40-aace-2c3788394b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:43.363796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5871e-bc97-4b40-aace-2c3788394b77 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:43.364926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5871e-bc97-4b40-aace-2c3788394b77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:43.365168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5871e-bc97-4b40-aace-2c3788394b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:43.367229 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5871e-bc97-4b40-aace-2c3788394b77 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:43.384324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 626/1250] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:43.385428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e9d7-6c66-4b81-92b6-9ec7c4b08937 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:43.490654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:43.519149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e9d7-6c66-4b81-92b6-9ec7c4b08937 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:43.562121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042d19-dead-4f0c-8bbd-2584a1587ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:43.562922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042d19-dead-4f0c-8bbd-2584a1587ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:43.563205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042d19-dead-4f0c-8bbd-2584a1587ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:43.563481 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042d19-dead-4f0c-8bbd-2584a1587ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:43.575941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042d19-dead-4f0c-8bbd-2584a1587ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:43.577562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042d19-dead-4f0c-8bbd-2584a1587ac3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fe042d19-dead-4f0c-8bbd-2584a1587ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:43.596377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:43.597498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:43.598849 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:43.598849 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:43.598849 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:43.598849 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:43.598849 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 625/1251] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:43.604207 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5871e-bc97-4b40-aace-2c3788394b77 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:43.746698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5871e-bc97-4b40-aace-2c3788394b77 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:43.791324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d11b2-8a51-40dd-9af3-a82f8d375683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:43.792131 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d11b2-8a51-40dd-9af3-a82f8d375683 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:43.792419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d11b2-8a51-40dd-9af3-a82f8d375683 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:43.792717 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d11b2-8a51-40dd-9af3-a82f8d375683 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:43.793574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d11b2-8a51-40dd-9af3-a82f8d375683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:43.793886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d11b2-8a51-40dd-9af3-a82f8d375683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:43.795378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d11b2-8a51-40dd-9af3-a82f8d375683 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:43.809435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 627/1252] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:43.815975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042d19-dead-4f0c-8bbd-2584a1587ac3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:43.935283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042d19-dead-4f0c-8bbd-2584a1587ac3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:43.969607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:43.980002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fe6b-8af7-44a1-9e24-f9d77143edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:43.980887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fe6b-8af7-44a1-9e24-f9d77143edba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:43.981228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fe6b-8af7-44a1-9e24-f9d77143edba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:43.981585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fe6b-8af7-44a1-9e24-f9d77143edba None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:43.992810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597fe6b-8af7-44a1-9e24-f9d77143edba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:43.994397 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597fe6b-8af7-44a1-9e24-f9d77143edba None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7597fe6b-8af7-44a1-9e24-f9d77143edba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:03:44.011623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:44.013749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:44.015115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 626/1253] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:03:44.018864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d11b2-8a51-40dd-9af3-a82f8d375683 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:44.093349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:44.153956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d11b2-8a51-40dd-9af3-a82f8d375683 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:44.199922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33321e7-45e3-46d3-a7fb-ca696a6e6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:44.200615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33321e7-45e3-46d3-a7fb-ca696a6e6163 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:44.200885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33321e7-45e3-46d3-a7fb-ca696a6e6163 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:44.201253 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33321e7-45e3-46d3-a7fb-ca696a6e6163 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:44.202168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33321e7-45e3-46d3-a7fb-ca696a6e6163 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:44.202485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33321e7-45e3-46d3-a7fb-ca696a6e6163 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:44.203952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33321e7-45e3-46d3-a7fb-ca696a6e6163 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:44.228250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 628/1254] 10.222.0.90 () {56 vars in 1143 bytes} [Tue Jun 21 15:03:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:44.234460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fe6b-8af7-44a1-9e24-f9d77143edba None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:44.382613 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fe6b-8af7-44a1-9e24-f9d77143edba None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:44.435981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81f6b1-9d56-45d1-8a2e-2443621630ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:44.436651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f6b1-9d56-45d1-8a2e-2443621630ea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:44.436933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f6b1-9d56-45d1-8a2e-2443621630ea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:44.437209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f6b1-9d56-45d1-8a2e-2443621630ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:44.507181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:44.526367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81f6b1-9d56-45d1-8a2e-2443621630ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:44.527848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81f6b1-9d56-45d1-8a2e-2443621630ea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:44.646659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 627/1255] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:03:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:03:44.652958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33321e7-45e3-46d3-a7fb-ca696a6e6163 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:44.782151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33321e7-45e3-46d3-a7fb-ca696a6e6163 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:44.798638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:44.834243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424b4a-afd5-40c4-8a95-75d74ef67b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:44.835144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424b4a-afd5-40c4-8a95-75d74ef67b47 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:44.835482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424b4a-afd5-40c4-8a95-75d74ef67b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:44.835796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424b4a-afd5-40c4-8a95-75d74ef67b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:44.847947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424b4a-afd5-40c4-8a95-75d74ef67b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:44.850213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424b4a-afd5-40c4-8a95-75d74ef67b47 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-15424b4a-afd5-40c4-8a95-75d74ef67b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:44.869701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:44.870726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:44.871661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:44.871661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:44.871661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:44.871661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:44.871661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 629/1256] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:44.876822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81f6b1-9d56-45d1-8a2e-2443621630ea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:44.978352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:44.992145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81f6b1-9d56-45d1-8a2e-2443621630ea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:45.033600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f97867-8885-44d9-b5c7-875404d12a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:45.034281 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f97867-8885-44d9-b5c7-875404d12a14 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:45.034567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f97867-8885-44d9-b5c7-875404d12a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:45.034849 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f97867-8885-44d9-b5c7-875404d12a14 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:45.035588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f97867-8885-44d9-b5c7-875404d12a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:45.036082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f97867-8885-44d9-b5c7-875404d12a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:45.037560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f97867-8885-44d9-b5c7-875404d12a14 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:45.050506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 628/1257] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:45.057527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424b4a-afd5-40c4-8a95-75d74ef67b47 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:45.181875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424b4a-afd5-40c4-8a95-75d74ef67b47 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:45.230473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5938d-ff50-4bf2-a90c-91670b72743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:45.231362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5938d-ff50-4bf2-a90c-91670b72743c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:45.231671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5938d-ff50-4bf2-a90c-91670b72743c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:45.231923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5938d-ff50-4bf2-a90c-91670b72743c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:45.240820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5938d-ff50-4bf2-a90c-91670b72743c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:45.242723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5938d-ff50-4bf2-a90c-91670b72743c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-70e5938d-ff50-4bf2-a90c-91670b72743c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:03:45.259347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:45.260561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:45.261556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:03:45.261556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:03:45.261556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:03:45.261556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:03:45.261556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:03:45.261556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:03:45.261556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:45.261556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:45.261556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 630/1258] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:45.267131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f97867-8885-44d9-b5c7-875404d12a14 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:45.387958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f97867-8885-44d9-b5c7-875404d12a14 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:45.429455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365218b-2373-47d0-889f-ba54ec107bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:45.430165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365218b-2373-47d0-889f-ba54ec107bed None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:45.430451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365218b-2373-47d0-889f-ba54ec107bed None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:45.430730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365218b-2373-47d0-889f-ba54ec107bed None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:45.431531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365218b-2373-47d0-889f-ba54ec107bed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:45.431849 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365218b-2373-47d0-889f-ba54ec107bed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:45.433304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365218b-2373-47d0-889f-ba54ec107bed None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:45.448608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 629/1259] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:45.455159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5938d-ff50-4bf2-a90c-91670b72743c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:45.486055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:45.603434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5938d-ff50-4bf2-a90c-91670b72743c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:45.659808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e7e43-ed42-466d-b83b-d179d2fe9cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:45.660965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e7e43-ed42-466d-b83b-d179d2fe9cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:45.661144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e7e43-ed42-466d-b83b-d179d2fe9cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:45.661392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e7e43-ed42-466d-b83b-d179d2fe9cd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:45.662321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e7e43-ed42-466d-b83b-d179d2fe9cd9 None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=5e916fba8123451587f5e13568630015) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:45.662636 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e7e43-ed42-466d-b83b-d179d2fe9cd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:45.664382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e7e43-ed42-466d-b83b-d179d2fe9cd9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:45.671022 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 631/1260] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:03:45 2022] GET /identity/v3/role_assignments?user.id=5e916fba8123451587f5e13568630015&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:47.708558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4cf6c-bdba-476e-8ee5-42d9a76a16e9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:47.709165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4cf6c-bdba-476e-8ee5-42d9a76a16e9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:47.709165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4cf6c-bdba-476e-8ee5-42d9a76a16e9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:47.710524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 630/1261] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:03:47.716123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551fad-1de1-48e2-b89c-7273e4382b20 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:47.716641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551fad-1de1-48e2-b89c-7273e4382b20 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:47.716641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551fad-1de1-48e2-b89c-7273e4382b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:47.735063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ea551fad-1de1-48e2-b89c-7273e4382b20 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:03:47.736330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea551fad-1de1-48e2-b89c-7273e4382b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:03:47.826016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 632/1262] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:03:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:03:47.849585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4cf6c-bdba-476e-8ee5-42d9a76a16e9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:47.860336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:47.950909 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4cf6c-bdba-476e-8ee5-42d9a76a16e9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:47.985313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f69eb1-fdf7-40be-994c-ea0cd14bef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:47.986048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f69eb1-fdf7-40be-994c-ea0cd14bef70 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:47.986333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f69eb1-fdf7-40be-994c-ea0cd14bef70 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:47.986608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f69eb1-fdf7-40be-994c-ea0cd14bef70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:47.997125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f69eb1-fdf7-40be-994c-ea0cd14bef70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-02f69eb1-fdf7-40be-994c-ea0cd14bef70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:03:48.004902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:48.006079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:48.007158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 631/1263] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:03:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:48.012414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551fad-1de1-48e2-b89c-7273e4382b20 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:48.032058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:48.111945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551fad-1de1-48e2-b89c-7273e4382b20 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:48.144943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fb5c9-580d-45cd-a253-7300f1901c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:48.146339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fb5c9-580d-45cd-a253-7300f1901c7c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:48.146705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fb5c9-580d-45cd-a253-7300f1901c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:48.146981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fb5c9-580d-45cd-a253-7300f1901c7c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:48.147742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fb5c9-580d-45cd-a253-7300f1901c7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:48.148048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fb5c9-580d-45cd-a253-7300f1901c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:48.149417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fb5c9-580d-45cd-a253-7300f1901c7c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:48.158031 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 633/1264] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:03:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:48.165056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f69eb1-fdf7-40be-994c-ea0cd14bef70 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:48.230705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:48.264704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f69eb1-fdf7-40be-994c-ea0cd14bef70 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:48.297168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46668bc-4a4d-4ce2-8342-28d75db9fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:48.297978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46668bc-4a4d-4ce2-8342-28d75db9fffa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:48.298264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46668bc-4a4d-4ce2-8342-28d75db9fffa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:48.298541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46668bc-4a4d-4ce2-8342-28d75db9fffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:48.308971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46668bc-4a4d-4ce2-8342-28d75db9fffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:48.310458 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46668bc-4a4d-4ce2-8342-28d75db9fffa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f46668bc-4a4d-4ce2-8342-28d75db9fffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:48.327406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:48.328496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:48.329671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:48.329671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:48.329671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:48.329671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:48.329671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 632/1265] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:48.336369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fb5c9-580d-45cd-a253-7300f1901c7c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:48.420604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:48.439820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fb5c9-580d-45cd-a253-7300f1901c7c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:48.473650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6611c2-263c-42be-8bec-be49352cf7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:48.474389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6611c2-263c-42be-8bec-be49352cf7eb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:48.474678 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6611c2-263c-42be-8bec-be49352cf7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:48.474956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6611c2-263c-42be-8bec-be49352cf7eb None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:48.475666 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6611c2-263c-42be-8bec-be49352cf7eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:48.475976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6611c2-263c-42be-8bec-be49352cf7eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:48.477344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6611c2-263c-42be-8bec-be49352cf7eb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:48.488880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 634/1266] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:48.494632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46668bc-4a4d-4ce2-8342-28d75db9fffa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:48.593669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46668bc-4a4d-4ce2-8342-28d75db9fffa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:48.612693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:48.627513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa8a73-3475-48b5-b394-b6a1c0df00d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:48.628306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa8a73-3475-48b5-b394-b6a1c0df00d0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:48.628590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa8a73-3475-48b5-b394-b6a1c0df00d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:48.628865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa8a73-3475-48b5-b394-b6a1c0df00d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:48.637071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa8a73-3475-48b5-b394-b6a1c0df00d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:48.638531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa8a73-3475-48b5-b394-b6a1c0df00d0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6caa8a73-3475-48b5-b394-b6a1c0df00d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:03:48.653966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:48.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:48.656118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 633/1267] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:48.661901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6611c2-263c-42be-8bec-be49352cf7eb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:48.767072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6611c2-263c-42be-8bec-be49352cf7eb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:48.800095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3dc84-63cf-469c-a71f-2f2d196c0a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:48.800749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3dc84-63cf-469c-a71f-2f2d196c0a6c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:48.801031 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3dc84-63cf-469c-a71f-2f2d196c0a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:48.801813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3dc84-63cf-469c-a71f-2f2d196c0a6c None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:48.802655 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3dc84-63cf-469c-a71f-2f2d196c0a6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:48.802965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3dc84-63cf-469c-a71f-2f2d196c0a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:48.804376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3dc84-63cf-469c-a71f-2f2d196c0a6c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:48.812836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:48.821238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 635/1268] 10.222.0.90 () {56 vars in 1143 bytes} [Tue Jun 21 15:03:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:48.826864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa8a73-3475-48b5-b394-b6a1c0df00d0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:48.928383 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa8a73-3475-48b5-b394-b6a1c0df00d0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:48.963173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d65d5-4315-4011-91f2-3691b05999be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:48.963963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d65d5-4315-4011-91f2-3691b05999be None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:48.964249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d65d5-4315-4011-91f2-3691b05999be None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:48.964528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d65d5-4315-4011-91f2-3691b05999be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:48.975847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d65d5-4315-4011-91f2-3691b05999be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:48.977287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d65d5-4315-4011-91f2-3691b05999be None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4f5d65d5-4315-4011-91f2-3691b05999be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:48.995594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:48.996704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:48.997850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:48.997850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:48.997850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:48.997850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:48.997850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 634/1269] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:49.002764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3dc84-63cf-469c-a71f-2f2d196c0a6c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:49.101223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3dc84-63cf-469c-a71f-2f2d196c0a6c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:49.134733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200ce66-c2c6-4863-9175-429d9e4ef194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:49.135385 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200ce66-c2c6-4863-9175-429d9e4ef194 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:49.135668 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200ce66-c2c6-4863-9175-429d9e4ef194 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:49.135945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200ce66-c2c6-4863-9175-429d9e4ef194 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:49.136659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200ce66-c2c6-4863-9175-429d9e4ef194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:49.136969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200ce66-c2c6-4863-9175-429d9e4ef194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:49.138375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200ce66-c2c6-4863-9175-429d9e4ef194 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:49.149355 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 636/1270] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:49.155010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d65d5-4315-4011-91f2-3691b05999be None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:49.191030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:49.261708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d65d5-4315-4011-91f2-3691b05999be None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:49.294996 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b055f8-5c8f-4229-8124-9c3a288b8db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:49.295779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b055f8-5c8f-4229-8124-9c3a288b8db0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:49.296065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b055f8-5c8f-4229-8124-9c3a288b8db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:49.296342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b055f8-5c8f-4229-8124-9c3a288b8db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:49.303701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b055f8-5c8f-4229-8124-9c3a288b8db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:49.305134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b055f8-5c8f-4229-8124-9c3a288b8db0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-33b055f8-5c8f-4229-8124-9c3a288b8db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:03:49.319099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:49.320000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:49.320951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:03:49.320951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:03:49.320951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:03:49.320951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:03:49.320951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:03:49.320951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:03:49.320951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:49.320951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:49.320951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 635/1271] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:49.326121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200ce66-c2c6-4863-9175-429d9e4ef194 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:49.384995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:49.428093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200ce66-c2c6-4863-9175-429d9e4ef194 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:49.461380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03364cf1-5f53-44d3-878d-7af665fa97d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:49.462058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03364cf1-5f53-44d3-878d-7af665fa97d1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:49.462346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03364cf1-5f53-44d3-878d-7af665fa97d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:49.462627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03364cf1-5f53-44d3-878d-7af665fa97d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:49.463411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03364cf1-5f53-44d3-878d-7af665fa97d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:49.463726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03364cf1-5f53-44d3-878d-7af665fa97d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:49.465154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03364cf1-5f53-44d3-878d-7af665fa97d1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:49.478757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 637/1272] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:49.484689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b055f8-5c8f-4229-8124-9c3a288b8db0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:49.577464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:49.586699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b055f8-5c8f-4229-8124-9c3a288b8db0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:49.621060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3cdbb-8c3f-4f67-9727-651c80bc17f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:49.621963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3cdbb-8c3f-4f67-9727-651c80bc17f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:49.622249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3cdbb-8c3f-4f67-9727-651c80bc17f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:49.622525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3cdbb-8c3f-4f67-9727-651c80bc17f1 None admin] PATH_INFO: `/v3/projects/4014ec50b88f4aef8757535c09207981/users/5e916fba8123451587f5e13568630015/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:49.624469 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3cdbb-8c3f-4f67-9727-651c80bc17f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4014ec50b88f4aef8757535c09207981, user_id=5e916fba8123451587f5e13568630015, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:49.625929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3cdbb-8c3f-4f67-9727-651c80bc17f1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:49.638942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 636/1273] 10.222.0.90 () {58 vars in 1439 bytes} [Tue Jun 21 15:03:49 2022] PUT /identity/v3/projects/4014ec50b88f4aef8757535c09207981/users/5e916fba8123451587f5e13568630015/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:03:51.689108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0cbab-b729-487e-83eb-378d24a2e8d6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:51.689725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0cbab-b729-487e-83eb-378d24a2e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:51.689826 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0cbab-b729-487e-83eb-378d24a2e8d6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:51.691326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 638/1274] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:03:51.697933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44824b1-b249-4279-ac59-081e3d9bb5ee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:51.698445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44824b1-b249-4279-ac59-081e3d9bb5ee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:51.698696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44824b1-b249-4279-ac59-081e3d9bb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:51.718038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c44824b1-b249-4279-ac59-081e3d9bb5ee None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:03:51.719357 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c44824b1-b249-4279-ac59-081e3d9bb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:03:51.791546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 637/1275] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:03:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:03:51.815869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0cbab-b729-487e-83eb-378d24a2e8d6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:51.921081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0cbab-b729-487e-83eb-378d24a2e8d6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:51.939441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:51.957355 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8071e-dc5e-4991-b7ce-f6a410905bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:51.959230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8071e-dc5e-4991-b7ce-f6a410905bcc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:51.959528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8071e-dc5e-4991-b7ce-f6a410905bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:51.959805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8071e-dc5e-4991-b7ce-f6a410905bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:51.970066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8071e-dc5e-4991-b7ce-f6a410905bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-21d8071e-dc5e-4991-b7ce-f6a410905bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 15:03:51.978024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:51.979212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:51.980303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 639/1276] 10.222.0.90 () {56 vars in 1096 bytes} [Tue Jun 21 15:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:51.985420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44824b1-b249-4279-ac59-081e3d9bb5ee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:52.068582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:52.087619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44824b1-b249-4279-ac59-081e3d9bb5ee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:52.122619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931d3c8-8662-43e5-836f-257fd99987ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:52.123283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931d3c8-8662-43e5-836f-257fd99987ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:52.123564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931d3c8-8662-43e5-836f-257fd99987ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:52.123837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931d3c8-8662-43e5-836f-257fd99987ef None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:52.124579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931d3c8-8662-43e5-836f-257fd99987ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:52.124883 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931d3c8-8662-43e5-836f-257fd99987ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:52.126271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931d3c8-8662-43e5-836f-257fd99987ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:52.135351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 638/1277] 10.222.0.90 () {56 vars in 1099 bytes} [Tue Jun 21 15:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:52.141086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8071e-dc5e-4991-b7ce-f6a410905bcc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:52.243806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8071e-dc5e-4991-b7ce-f6a410905bcc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:52.276721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267857b-67c8-4fb1-a6a8-d8db8151a77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:52.277530 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267857b-67c8-4fb1-a6a8-d8db8151a77c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:52.277817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267857b-67c8-4fb1-a6a8-d8db8151a77c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:52.278097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267857b-67c8-4fb1-a6a8-d8db8151a77c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:52.289564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267857b-67c8-4fb1-a6a8-d8db8151a77c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:52.291008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267857b-67c8-4fb1-a6a8-d8db8151a77c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5267857b-67c8-4fb1-a6a8-d8db8151a77c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:52.308370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:52.309492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:52.310626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:52.310626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:52.310626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:52.310626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:52.310626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 640/1278] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:52.315334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931d3c8-8662-43e5-836f-257fd99987ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:52.419884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931d3c8-8662-43e5-836f-257fd99987ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:52.453122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15463c-8e50-43d5-a04f-ecdb4ee9dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:52.453799 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15463c-8e50-43d5-a04f-ecdb4ee9dcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:52.454080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15463c-8e50-43d5-a04f-ecdb4ee9dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:52.454356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15463c-8e50-43d5-a04f-ecdb4ee9dcf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:52.455061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15463c-8e50-43d5-a04f-ecdb4ee9dcf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:52.455365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15463c-8e50-43d5-a04f-ecdb4ee9dcf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:52.456731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15463c-8e50-43d5-a04f-ecdb4ee9dcf3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:52.468542 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 639/1279] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:52.475011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267857b-67c8-4fb1-a6a8-d8db8151a77c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:52.505604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:52.577227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267857b-67c8-4fb1-a6a8-d8db8151a77c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:52.611829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a711-0f7a-4901-8373-8cd15f2b100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:52.612630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a711-0f7a-4901-8373-8cd15f2b100a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:52.612973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a711-0f7a-4901-8373-8cd15f2b100a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:52.613283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066a711-0f7a-4901-8373-8cd15f2b100a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:52.621605 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a711-0f7a-4901-8373-8cd15f2b100a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:52.623048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066a711-0f7a-4901-8373-8cd15f2b100a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2066a711-0f7a-4901-8373-8cd15f2b100a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 15:03:52.644084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:52.651190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:52.652577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 641/1280] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 15:03:52.653250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15463c-8e50-43d5-a04f-ecdb4ee9dcf3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:52.658480 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:52.757716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15463c-8e50-43d5-a04f-ecdb4ee9dcf3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:52.792281 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11922bd-12aa-4525-aeb7-48c7b2c6690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:52.792955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11922bd-12aa-4525-aeb7-48c7b2c6690e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:52.793244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11922bd-12aa-4525-aeb7-48c7b2c6690e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:52.793554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11922bd-12aa-4525-aeb7-48c7b2c6690e None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:52.794401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11922bd-12aa-4525-aeb7-48c7b2c6690e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:52.794717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11922bd-12aa-4525-aeb7-48c7b2c6690e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:52.796148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11922bd-12aa-4525-aeb7-48c7b2c6690e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:52.813306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 640/1281] 10.222.0.90 () {56 vars in 1143 bytes} [Tue Jun 21 15:03:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:52.819670 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a711-0f7a-4901-8373-8cd15f2b100a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:52.911418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:52.921897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066a711-0f7a-4901-8373-8cd15f2b100a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:52.959348 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a8438-b1d7-4f99-89fd-4d0e44c81127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:52.960001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a8438-b1d7-4f99-89fd-4d0e44c81127 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:52.960282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a8438-b1d7-4f99-89fd-4d0e44c81127 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:52.960557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a8438-b1d7-4f99-89fd-4d0e44c81127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:53.030402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a8438-b1d7-4f99-89fd-4d0e44c81127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:53.031770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a8438-b1d7-4f99-89fd-4d0e44c81127 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:53.122477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:53.133278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 642/1282] 10.222.0.90 () {58 vars in 1282 bytes} [Tue Jun 21 15:03:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 15:03:53.139217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11922bd-12aa-4525-aeb7-48c7b2c6690e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:53.203254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:53.243214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11922bd-12aa-4525-aeb7-48c7b2c6690e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:53.277138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae7347-1aa9-4889-aa2d-77381157ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:53.277954 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae7347-1aa9-4889-aa2d-77381157ab10 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:53.278242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae7347-1aa9-4889-aa2d-77381157ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:53.278513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae7347-1aa9-4889-aa2d-77381157ab10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:53.289783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae7347-1aa9-4889-aa2d-77381157ab10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:53.291159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae7347-1aa9-4889-aa2d-77381157ab10 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-42ae7347-1aa9-4889-aa2d-77381157ab10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 15:03:53.309335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:53.310541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:53.311910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 15:03:53.311910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 15:03:53.311910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 15:03:53.311910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:53.311910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 641/1283] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:53.316359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a8438-b1d7-4f99-89fd-4d0e44c81127 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:53.417571 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a8438-b1d7-4f99-89fd-4d0e44c81127 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:53.451589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73e28-073e-4b23-b088-ffa5f909eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:53.452247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73e28-073e-4b23-b088-ffa5f909eed0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:53.452530 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73e28-073e-4b23-b088-ffa5f909eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:53.452808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73e28-073e-4b23-b088-ffa5f909eed0 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:53.453593 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc73e28-073e-4b23-b088-ffa5f909eed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:53.453910 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc73e28-073e-4b23-b088-ffa5f909eed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:53.455274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc73e28-073e-4b23-b088-ffa5f909eed0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:53.467884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 643/1284] 10.222.0.90 () {56 vars in 1109 bytes} [Tue Jun 21 15:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:53.473700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae7347-1aa9-4889-aa2d-77381157ab10 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:53.573643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae7347-1aa9-4889-aa2d-77381157ab10 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:53.587859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:53.607495 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00d5af-08ba-47a4-8fe8-32b2d424bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:53.608279 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00d5af-08ba-47a4-8fe8-32b2d424bf80 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:53.608563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00d5af-08ba-47a4-8fe8-32b2d424bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:53.608839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00d5af-08ba-47a4-8fe8-32b2d424bf80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:53.615471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00d5af-08ba-47a4-8fe8-32b2d424bf80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:53.616896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00d5af-08ba-47a4-8fe8-32b2d424bf80 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ca00d5af-08ba-47a4-8fe8-32b2d424bf80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 15:03:53.630885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:53.632215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:53.633362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 15:03:53.633362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 15:03:53.633362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 15:03:53.633362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 15:03:53.633362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 15:03:53.633362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 15:03:53.633362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 15:03:53.633362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 21 15:03:53.633362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 642/1285] 10.222.0.90 () {56 vars in 1111 bytes} [Tue Jun 21 15:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:53.638261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73e28-073e-4b23-b088-ffa5f909eed0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:53.695113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:53.747603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73e28-073e-4b23-b088-ffa5f909eed0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:53.782484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64c038-82c3-445d-8d70-6b3903649b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:53.783131 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64c038-82c3-445d-8d70-6b3903649b80 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:53.783411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64c038-82c3-445d-8d70-6b3903649b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:53.783686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64c038-82c3-445d-8d70-6b3903649b80 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:53.784456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64c038-82c3-445d-8d70-6b3903649b80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:53.784763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64c038-82c3-445d-8d70-6b3903649b80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:53.786430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64c038-82c3-445d-8d70-6b3903649b80 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:53.798513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 644/1286] 10.222.0.90 () {56 vars in 1148 bytes} [Tue Jun 21 15:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:53.805240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00d5af-08ba-47a4-8fe8-32b2d424bf80 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:53.904897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00d5af-08ba-47a4-8fe8-32b2d424bf80 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:53.938079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bfd84-b0d9-41c8-af41-72002173910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:53.938731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfd84-b0d9-41c8-af41-72002173910b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:53.939013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfd84-b0d9-41c8-af41-72002173910b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:53.939287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfd84-b0d9-41c8-af41-72002173910b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:53.940107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bfd84-b0d9-41c8-af41-72002173910b None admin] RBAC: Adding query filter params (role.id=4bdd5f7d3834497fbad569bb21092a6e, scope.project.id=4014ec50b88f4aef8757535c09207981, user.id=5e916fba8123451587f5e13568630015) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:53.940418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bfd84-b0d9-41c8-af41-72002173910b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:53.941976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bfd84-b0d9-41c8-af41-72002173910b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:53.948508 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 643/1287] 10.222.0.90 () {56 vars in 1374 bytes} [Tue Jun 21 15:03:53 2022] GET /identity/v3/role_assignments?user.id=5e916fba8123451587f5e13568630015&scope.project.id=4014ec50b88f4aef8757535c09207981&role.id=4bdd5f7d3834497fbad569bb21092a6e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:56.031922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ea80b-faa0-48c0-819a-8ce00e0fe37b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:56.032498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ea80b-faa0-48c0-819a-8ce00e0fe37b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:56.032498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ea80b-faa0-48c0-819a-8ce00e0fe37b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:56.033967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 645/1288] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:03:56.040487 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf5fc-8659-438f-b11c-817f0d4505a2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:56.040940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf5fc-8659-438f-b11c-817f0d4505a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:56.041050 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bf5fc-8659-438f-b11c-817f0d4505a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:56.066182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-727bf5fc-8659-438f-b11c-817f0d4505a2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:03:56.067417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-727bf5fc-8659-438f-b11c-817f0d4505a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:03:56.100440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:56.139808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 644/1289] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:03:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:03:56.165145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ea80b-faa0-48c0-819a-8ce00e0fe37b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:56.267640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ea80b-faa0-48c0-819a-8ce00e0fe37b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:56.278923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:56.303559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9fa84-34e6-49f5-9660-d2e4f2e86ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:56.304343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9fa84-34e6-49f5-9660-d2e4f2e86ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:56.304627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9fa84-34e6-49f5-9660-d2e4f2e86ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:56.304906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9fa84-34e6-49f5-9660-d2e4f2e86ac4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:56.305590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9fa84-34e6-49f5-9660-d2e4f2e86ac4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:56.306958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9fa84-34e6-49f5-9660-d2e4f2e86ac4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-87c9fa84-34e6-49f5-9660-d2e4f2e86ac4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:03:56.319189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:03:56.320425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:03:56.321546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 646/1290] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:03:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:03:56.325775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf5fc-8659-438f-b11c-817f0d4505a2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:56.427950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bf5fc-8659-438f-b11c-817f0d4505a2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:56.466720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b41a9-00ee-446d-a9aa-5dd298de0000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:56.467401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b41a9-00ee-446d-a9aa-5dd298de0000 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:56.467686 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b41a9-00ee-446d-a9aa-5dd298de0000 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:56.467968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b41a9-00ee-446d-a9aa-5dd298de0000 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:56.468685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b41a9-00ee-446d-a9aa-5dd298de0000 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:56.468995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b41a9-00ee-446d-a9aa-5dd298de0000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:56.470399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b41a9-00ee-446d-a9aa-5dd298de0000 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:56.476223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 645/1291] 10.222.0.90 () {56 vars in 1116 bytes} [Tue Jun 21 15:03:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:56.482252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9fa84-34e6-49f5-9660-d2e4f2e86ac4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:56.581144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9fa84-34e6-49f5-9660-d2e4f2e86ac4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:56.614414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b0abb-5e8a-450f-b177-c27e1b534c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:56.614922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b0abb-5e8a-450f-b177-c27e1b534c9e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:56.615204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b0abb-5e8a-450f-b177-c27e1b534c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:56.615480 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b0abb-5e8a-450f-b177-c27e1b534c9e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:56.616183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b0abb-5e8a-450f-b177-c27e1b534c9e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:03:56.616490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b0abb-5e8a-450f-b177-c27e1b534c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:56.617884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b0abb-5e8a-450f-b177-c27e1b534c9e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:56.622580 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 647/1292] 10.222.0.90 () {56 vars in 1116 bytes} [Tue Jun 21 15:03:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:03:58.762762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520b9ce-8048-4bef-ba1c-94884d69cb59 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:58.763337 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520b9ce-8048-4bef-ba1c-94884d69cb59 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:58.763337 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520b9ce-8048-4bef-ba1c-94884d69cb59 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:58.764694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 646/1293] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:03:58.770239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28944-d54e-4d51-bba5-3bff2292f963 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:58.770239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28944-d54e-4d51-bba5-3bff2292f963 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:58.771713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28944-d54e-4d51-bba5-3bff2292f963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:58.789572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c0b28944-d54e-4d51-bba5-3bff2292f963 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:03:58.790814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c0b28944-d54e-4d51-bba5-3bff2292f963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:03:58.824416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:58.867340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 648/1294] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:03:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:03:58.891196 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520b9ce-8048-4bef-ba1c-94884d69cb59 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:03:58.930402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:03:59.024029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520b9ce-8048-4bef-ba1c-94884d69cb59 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:03:59.071625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad372f92-65c6-40bc-800c-465a1fc440b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:03:59.072373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad372f92-65c6-40bc-800c-465a1fc440b7 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:03:59.072809 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad372f92-65c6-40bc-800c-465a1fc440b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:03:59.072999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad372f92-65c6-40bc-800c-465a1fc440b7 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:03:59.073881 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad372f92-65c6-40bc-800c-465a1fc440b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:03:59.075385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad372f92-65c6-40bc-800c-465a1fc440b7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:03:59.109363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 647/1295] 10.222.0.90 () {60 vars in 1141 bytes} [Tue Jun 21 15:03:58 2022] POST /identity/v3/services => generated 246 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:04:01.330326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230fc0-edb2-4c8c-ab44-228544c83ed4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:01.330968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230fc0-edb2-4c8c-ab44-228544c83ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:01.330968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230fc0-edb2-4c8c-ab44-228544c83ed4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:01.332259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 649/1296] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:04:01.338101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746f08e-e352-4764-97b6-69fbb6c136b1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:01.338586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746f08e-e352-4764-97b6-69fbb6c136b1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:01.338689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746f08e-e352-4764-97b6-69fbb6c136b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:01.355283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0746f08e-e352-4764-97b6-69fbb6c136b1 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:04:01.356456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0746f08e-e352-4764-97b6-69fbb6c136b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:04:01.430729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 648/1297] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:04:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 15:04:01.456852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230fc0-edb2-4c8c-ab44-228544c83ed4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:04:01.559054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230fc0-edb2-4c8c-ab44-228544c83ed4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:04:01.594155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ee19-1f80-493a-8024-aafeded0c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:04:01.594871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ee19-1f80-493a-8024-aafeded0c788 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:01.595154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ee19-1f80-493a-8024-aafeded0c788 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:01.595430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ee19-1f80-493a-8024-aafeded0c788 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:01.596082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04ee19-1f80-493a-8024-aafeded0c788 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:04:01.597458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04ee19-1f80-493a-8024-aafeded0c788 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cd04ee19-1f80-493a-8024-aafeded0c788 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:04:01.609402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:04:01.610751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:04:01.611923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 650/1298] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:04:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:04:01.617338 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746f08e-e352-4764-97b6-69fbb6c136b1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:04:01.636137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:04:01.721724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746f08e-e352-4764-97b6-69fbb6c136b1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:04:01.758603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4dd63-6c25-461b-af70-3272505e46ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:04:01.759269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4dd63-6c25-461b-af70-3272505e46ab None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:01.759558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4dd63-6c25-461b-af70-3272505e46ab None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:01.759839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4dd63-6c25-461b-af70-3272505e46ab None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:01.760552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4dd63-6c25-461b-af70-3272505e46ab None admin] RBAC: Adding query filter params (name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:04:01.760865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4dd63-6c25-461b-af70-3272505e46ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:04:01.762266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4dd63-6c25-461b-af70-3272505e46ab None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:04:01.767548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 649/1299] 10.222.0.90 () {56 vars in 1116 bytes} [Tue Jun 21 15:04:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:04:01.773719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ee19-1f80-493a-8024-aafeded0c788 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:04:01.805989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:04:01.874692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ee19-1f80-493a-8024-aafeded0c788 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:04:01.906909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2419b2e-fa25-4940-8365-6b63f1c2f054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:04:01.907557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2419b2e-fa25-4940-8365-6b63f1c2f054 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:01.907838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2419b2e-fa25-4940-8365-6b63f1c2f054 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:01.908112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2419b2e-fa25-4940-8365-6b63f1c2f054 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:01.908893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2419b2e-fa25-4940-8365-6b63f1c2f054 None admin] RBAC: Adding query filter params (interface=public, service_id=42d30b496fc54d5198658d19239e6d47, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:04:01.909206 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2419b2e-fa25-4940-8365-6b63f1c2f054 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:04:01.911315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2419b2e-fa25-4940-8365-6b63f1c2f054 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:04:01.916874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 651/1300] 10.222.0.90 () {56 vars in 1251 bytes} [Tue Jun 21 15:04:01 2022] GET /identity/v3/endpoints?service_id=42d30b496fc54d5198658d19239e6d47&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:04:01.922549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4dd63-6c25-461b-af70-3272505e46ab None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:04:02.004612 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:04:02.022707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4dd63-6c25-461b-af70-3272505e46ab None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:04:02.061885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da16d6-d222-4e08-9146-3f31d28bc8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:04:02.062550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da16d6-d222-4e08-9146-3f31d28bc8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:02.062841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da16d6-d222-4e08-9146-3f31d28bc8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:02.063121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da16d6-d222-4e08-9146-3f31d28bc8a5 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:02.063803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da16d6-d222-4e08-9146-3f31d28bc8a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:04:02.065175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da16d6-d222-4e08-9146-3f31d28bc8a5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:04:02.072090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 650/1301] 10.222.0.90 () {56 vars in 1087 bytes} [Tue Jun 21 15:04:01 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:04:04.107852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda267b1-1c28-4b7e-a190-539363b3f19c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:04.108376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda267b1-1c28-4b7e-a190-539363b3f19c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:04.108535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda267b1-1c28-4b7e-a190-539363b3f19c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:04.109946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 652/1302] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:04:04.115812 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73594bf1-7d24-4448-9bd2-70a57855a1f8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:04.116245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73594bf1-7d24-4448-9bd2-70a57855a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:04.116374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73594bf1-7d24-4448-9bd2-70a57855a1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:04.134781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-73594bf1-7d24-4448-9bd2-70a57855a1f8 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:04:04.135969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-73594bf1-7d24-4448-9bd2-70a57855a1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:04:04.204571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 651/1303] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:04:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 15:04:04.228603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda267b1-1c28-4b7e-a190-539363b3f19c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:04:04.334924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:04:04.342451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda267b1-1c28-4b7e-a190-539363b3f19c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:04:04.376335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d4815-732e-4eca-907e-e9d2ef475c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:04:04.377125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d4815-732e-4eca-907e-e9d2ef475c61 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:04.377412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d4815-732e-4eca-907e-e9d2ef475c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:04.377723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d4815-732e-4eca-907e-e9d2ef475c61 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:04.378380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d4815-732e-4eca-907e-e9d2ef475c61 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:04:04.380105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d4815-732e-4eca-907e-e9d2ef475c61 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8f2d4815-732e-4eca-907e-e9d2ef475c61 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 15:04:04.391776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 15:04:04.393028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 21 15:04:04.393959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 653/1304] 10.222.0.90 () {56 vars in 1117 bytes} [Tue Jun 21 15:04:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 15:04:04.399609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73594bf1-7d24-4448-9bd2-70a57855a1f8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:04:04.473701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:04:04.495593 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73594bf1-7d24-4448-9bd2-70a57855a1f8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:04:04.528140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21f0d1-d152-4088-abb9-0bbd5ed06342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:04:04.528788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21f0d1-d152-4088-abb9-0bbd5ed06342 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:04.529071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21f0d1-d152-4088-abb9-0bbd5ed06342 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:04.529346 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21f0d1-d152-4088-abb9-0bbd5ed06342 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:04.530073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21f0d1-d152-4088-abb9-0bbd5ed06342 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:04:04.530380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21f0d1-d152-4088-abb9-0bbd5ed06342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:04:04.531731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21f0d1-d152-4088-abb9-0bbd5ed06342 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:04:04.537384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 652/1305] 10.222.0.90 () {56 vars in 1116 bytes} [Tue Jun 21 15:04:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:04:04.543525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d4815-732e-4eca-907e-e9d2ef475c61 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:04:04.642750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d4815-732e-4eca-907e-e9d2ef475c61 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:04:04.677254 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db7e2-0b02-4a0b-b547-84faa3f9e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:04:04.677940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db7e2-0b02-4a0b-b547-84faa3f9e098 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:04:04.678228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db7e2-0b02-4a0b-b547-84faa3f9e098 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:04:04.678508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db7e2-0b02-4a0b-b547-84faa3f9e098 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:04:04.679240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84db7e2-0b02-4a0b-b547-84faa3f9e098 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:04:04.680641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84db7e2-0b02-4a0b-b547-84faa3f9e098 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:04:04.698992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 654/1306] 10.222.0.90 () {60 vars in 1144 bytes} [Tue Jun 21 15:04:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:04:14.533806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=30 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:04:14.694926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:11.686355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e327f8f-9844-490e-a1da-18684db755e6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:11.687449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e327f8f-9844-490e-a1da-18684db755e6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:11.687957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e327f8f-9844-490e-a1da-18684db755e6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:11.696397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a817-cd0e-4109-9369-8c1adcaae3a9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:11.697383 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a817-cd0e-4109-9369-8c1adcaae3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:11.697993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a817-cd0e-4109-9369-8c1adcaae3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:11.701680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 653/1307] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:11 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:11.790972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8123a817-cd0e-4109-9369-8c1adcaae3a9 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:11.792199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8123a817-cd0e-4109-9369-8c1adcaae3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:11.946079 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 655/1308] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:11.999595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2080e5a-d707-45e6-a3f2-bfe988d44dbc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:11.999962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2080e5a-d707-45e6-a3f2-bfe988d44dbc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:12.000334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2080e5a-d707-45e6-a3f2-bfe988d44dbc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:12.002721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 654/1309] 10.222.0.90 () {54 vars in 964 bytes} [Tue Jun 21 15:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:12.012796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec4d4-5c5e-4fec-810f-d93cdd633243 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:12.013501 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec4d4-5c5e-4fec-810f-d93cdd633243 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:12.014287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec4d4-5c5e-4fec-810f-d93cdd633243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:12.137096 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6e3ec4d4-5c5e-4fec-810f-d93cdd633243 None None] MFA Rules not processed for user `08b3093a7415419cbb6d50701b09b7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:12.138737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e3ec4d4-5c5e-4fec-810f-d93cdd633243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:12.165004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:12.229500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 656/1310] 10.222.0.90 () {58 vars in 1061 bytes} [Tue Jun 21 15:05:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:12.239326 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2080e5a-d707-45e6-a3f2-bfe988d44dbc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:12.241066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c2080e5a-d707-45e6-a3f2-bfe988d44dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:12.365116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2080e5a-d707-45e6-a3f2-bfe988d44dbc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:12.449537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8651cb-7987-4bde-830c-2467d1d181aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:12.450206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8651cb-7987-4bde-830c-2467d1d181aa service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:12.450536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8651cb-7987-4bde-830c-2467d1d181aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:12.450779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8651cb-7987-4bde-830c-2467d1d181aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:12.452490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1f8651cb-7987-4bde-830c-2467d1d181aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:12.516395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:12.610033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8651cb-7987-4bde-830c-2467d1d181aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:12.612126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8651cb-7987-4bde-830c-2467d1d181aa service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:12.639578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 655/1311] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:15.075127 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e098-a324-4e7a-8d9f-a31733a3550a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:15.075675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e098-a324-4e7a-8d9f-a31733a3550a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:15.075675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e098-a324-4e7a-8d9f-a31733a3550a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:15.077349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 657/1312] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:15.083511 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0aa6d-8eac-4359-a20f-79d4065736fc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:15.084055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0aa6d-8eac-4359-a20f-79d4065736fc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:15.084055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0aa6d-8eac-4359-a20f-79d4065736fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:15.182065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bcd0aa6d-8eac-4359-a20f-79d4065736fc None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:15.183335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bcd0aa6d-8eac-4359-a20f-79d4065736fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:15.325069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 656/1313] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:15.364371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e098-a324-4e7a-8d9f-a31733a3550a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:15.366018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a629e098-a324-4e7a-8d9f-a31733a3550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:15.515473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e098-a324-4e7a-8d9f-a31733a3550a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:15.638375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:15.643467 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4add85-40b7-42fd-a76a-aaffd9f8ba33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:15.644892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4add85-40b7-42fd-a76a-aaffd9f8ba33 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:15.645481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4add85-40b7-42fd-a76a-aaffd9f8ba33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:15.645991 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4add85-40b7-42fd-a76a-aaffd9f8ba33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:15.648316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf4add85-40b7-42fd-a76a-aaffd9f8ba33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:15.779550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4add85-40b7-42fd-a76a-aaffd9f8ba33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:15.781053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4add85-40b7-42fd-a76a-aaffd9f8ba33 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:15.803570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 658/1314] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:18.273599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab01b60-0324-439e-a763-dc14342335f1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:18.274137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab01b60-0324-439e-a763-dc14342335f1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:18.274237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab01b60-0324-439e-a763-dc14342335f1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:18.275539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 657/1315] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:18.281023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e2c5-d045-46d0-ab8f-03073c4f1683 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:18.281580 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e2c5-d045-46d0-ab8f-03073c4f1683 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:18.281860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86e2c5-d045-46d0-ab8f-03073c4f1683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:18.346746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6e86e2c5-d045-46d0-ab8f-03073c4f1683 None None] MFA Rules not processed for user `c5bb8b07d7ca43fca8f1f46e762df820`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:18.347999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e86e2c5-d045-46d0-ab8f-03073c4f1683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:18.400070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:18.447620 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 659/1316] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:18.489779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab01b60-0324-439e-a763-dc14342335f1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:18.491345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1ab01b60-0324-439e-a763-dc14342335f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:18.501238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:18.599888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab01b60-0324-439e-a763-dc14342335f1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:18.672658 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b78bf2-6e0c-4de5-927e-727c837e0739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:18.673306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b78bf2-6e0c-4de5-927e-727c837e0739 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:18.673627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b78bf2-6e0c-4de5-927e-727c837e0739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:18.674436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b78bf2-6e0c-4de5-927e-727c837e0739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:18.676086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93b78bf2-6e0c-4de5-927e-727c837e0739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:18.741299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:18.789905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b78bf2-6e0c-4de5-927e-727c837e0739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:18.791346 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b78bf2-6e0c-4de5-927e-727c837e0739 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:18.810780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 658/1317] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:21.466358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6d63e-974f-4990-9519-7d678d6d0a59 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:21.466358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6d63e-974f-4990-9519-7d678d6d0a59 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:21.467002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6d63e-974f-4990-9519-7d678d6d0a59 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:21.467863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 660/1318] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:05:21.475032 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec334c37-abe3-421e-bdc6-58d83f84decd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:21.475572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec334c37-abe3-421e-bdc6-58d83f84decd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:21.475673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec334c37-abe3-421e-bdc6-58d83f84decd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:21.555577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ec334c37-abe3-421e-bdc6-58d83f84decd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:21.556788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ec334c37-abe3-421e-bdc6-58d83f84decd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:21.677737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 659/1319] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:21.731840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c204a-baed-4f90-9915-9dd75e382001 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:21.732042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c204a-baed-4f90-9915-9dd75e382001 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:21.732314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c204a-baed-4f90-9915-9dd75e382001 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:21.733711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 661/1320] 10.222.0.90 () {54 vars in 964 bytes} [Tue Jun 21 15:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:21.740738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c32bd3-be5d-4145-bd0c-f7c741705ddf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:21.741029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c32bd3-be5d-4145-bd0c-f7c741705ddf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:21.741310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c32bd3-be5d-4145-bd0c-f7c741705ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:21.762676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:21.818768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-50c32bd3-be5d-4145-bd0c-f7c741705ddf None None] MFA Rules not processed for user `08b3093a7415419cbb6d50701b09b7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:21.819984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-50c32bd3-be5d-4145-bd0c-f7c741705ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:21.899206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 660/1321] 10.222.0.90 () {58 vars in 1061 bytes} [Tue Jun 21 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:21.909833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c204a-baed-4f90-9915-9dd75e382001 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:21.911888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-934c204a-baed-4f90-9915-9dd75e382001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:22.022702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c204a-baed-4f90-9915-9dd75e382001 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:22.097319 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd672d-d90a-4166-8824-b2cf697d6ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:22.097993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd672d-d90a-4166-8824-b2cf697d6ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:22.098283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd672d-d90a-4166-8824-b2cf697d6ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:22.098564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd672d-d90a-4166-8824-b2cf697d6ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:22.100222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-74fd672d-d90a-4166-8824-b2cf697d6ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:22.107674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:22.208520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd672d-d90a-4166-8824-b2cf697d6ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:22.209967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd672d-d90a-4166-8824-b2cf697d6ed2 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:22.228835 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 662/1322] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:25.514602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395530ec-fd45-49aa-b8d4-45a647feafb1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:25.515145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395530ec-fd45-49aa-b8d4-45a647feafb1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:25.515145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395530ec-fd45-49aa-b8d4-45a647feafb1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:25.516542 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 661/1323] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:25.525212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffe2ef-48b2-41b1-ace5-bf9eac93a0f3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:25.525212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffe2ef-48b2-41b1-ace5-bf9eac93a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:25.525212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffe2ef-48b2-41b1-ace5-bf9eac93a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:25.593523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-74ffe2ef-48b2-41b1-ace5-bf9eac93a0f3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:25.594709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-74ffe2ef-48b2-41b1-ace5-bf9eac93a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:25.654199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:25.704128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 663/1324] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:05:25.742157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395530ec-fd45-49aa-b8d4-45a647feafb1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:25.743794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-395530ec-fd45-49aa-b8d4-45a647feafb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:25.882130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395530ec-fd45-49aa-b8d4-45a647feafb1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:25.894276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:25.962238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721d9bb-1fd7-4345-8029-3fb65d539ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:25.962820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721d9bb-1fd7-4345-8029-3fb65d539ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:25.963103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721d9bb-1fd7-4345-8029-3fb65d539ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:25.963380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721d9bb-1fd7-4345-8029-3fb65d539ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:25.965011 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2721d9bb-1fd7-4345-8029-3fb65d539ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:26.093266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721d9bb-1fd7-4345-8029-3fb65d539ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:26.094665 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721d9bb-1fd7-4345-8029-3fb65d539ee0 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:26.115480 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 662/1325] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:28.269921 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99aa9-ad7e-48b3-803d-5b3daf115ca1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:28.270455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99aa9-ad7e-48b3-803d-5b3daf115ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:28.270455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99aa9-ad7e-48b3-803d-5b3daf115ca1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:28.271755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 664/1326] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:28.277217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15939fe9-bec3-4030-991f-a1df55b2cec8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:28.277677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15939fe9-bec3-4030-991f-a1df55b2cec8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:28.277785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15939fe9-bec3-4030-991f-a1df55b2cec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:28.327559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:28.347758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-15939fe9-bec3-4030-991f-a1df55b2cec8 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:28.348967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-15939fe9-bec3-4030-991f-a1df55b2cec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:28.451474 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 663/1327] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:28.492588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99aa9-ad7e-48b3-803d-5b3daf115ca1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:28.494158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-77b99aa9-ad7e-48b3-803d-5b3daf115ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:28.605271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99aa9-ad7e-48b3-803d-5b3daf115ca1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:28.690124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996bbe2-de3c-4ef3-94a4-54f89cce2769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:28.690815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996bbe2-de3c-4ef3-94a4-54f89cce2769 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:28.691132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996bbe2-de3c-4ef3-94a4-54f89cce2769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:28.691416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996bbe2-de3c-4ef3-94a4-54f89cce2769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:28.693222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9996bbe2-de3c-4ef3-94a4-54f89cce2769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:28.711488 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:28.810562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996bbe2-de3c-4ef3-94a4-54f89cce2769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:28.812003 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996bbe2-de3c-4ef3-94a4-54f89cce2769 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:28.832619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 665/1328] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:30.985065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4dc16-aa66-46f5-848f-16bcc5aea6a2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:30.985725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4dc16-aa66-46f5-848f-16bcc5aea6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:30.985725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4dc16-aa66-46f5-848f-16bcc5aea6a2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:30.987198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 664/1329] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:30.992818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19f462-87ab-4eb9-8e41-01a56f5a49dd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:30.993426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19f462-87ab-4eb9-8e41-01a56f5a49dd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:30.993426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19f462-87ab-4eb9-8e41-01a56f5a49dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:31.070122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bd19f462-87ab-4eb9-8e41-01a56f5a49dd None None] MFA Rules not processed for user `c5bb8b07d7ca43fca8f1f46e762df820`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:31.071288 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bd19f462-87ab-4eb9-8e41-01a56f5a49dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:31.140598 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:31.188354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 666/1330] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:31.227278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4dc16-aa66-46f5-848f-16bcc5aea6a2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:31.228825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-31b4dc16-aa66-46f5-848f-16bcc5aea6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:31.345324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4dc16-aa66-46f5-848f-16bcc5aea6a2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:31.366313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:31.426293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0621d-b224-4429-b742-a9fa7d1ebdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:31.426950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0621d-b224-4429-b742-a9fa7d1ebdda service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:31.427232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0621d-b224-4429-b742-a9fa7d1ebdda service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:31.427510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0621d-b224-4429-b742-a9fa7d1ebdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:31.429169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5d0621d-b224-4429-b742-a9fa7d1ebdda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:31.542104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0621d-b224-4429-b742-a9fa7d1ebdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:31.543557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0621d-b224-4429-b742-a9fa7d1ebdda service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:31.563108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 665/1331] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:33.984031 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40a00d-b3bd-4d96-ae2d-a54d490d91be None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:33.984622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40a00d-b3bd-4d96-ae2d-a54d490d91be None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:33.984622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40a00d-b3bd-4d96-ae2d-a54d490d91be None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:33.986040 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 667/1332] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:33.991731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347790-6470-4e01-9dfa-a38ab44631fa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:33.992243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347790-6470-4e01-9dfa-a38ab44631fa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:33.992351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347790-6470-4e01-9dfa-a38ab44631fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:34.057048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:34.060093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ba347790-6470-4e01-9dfa-a38ab44631fa None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:34.061882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba347790-6470-4e01-9dfa-a38ab44631fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:34.171385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 666/1333] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:34.208749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40a00d-b3bd-4d96-ae2d-a54d490d91be None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:34.210381 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8d40a00d-b3bd-4d96-ae2d-a54d490d91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:34.318755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40a00d-b3bd-4d96-ae2d-a54d490d91be None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:34.393911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c994d-4490-486f-b847-72564e948203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:34.394557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c994d-4490-486f-b847-72564e948203 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:34.394839 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c994d-4490-486f-b847-72564e948203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:34.395123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c994d-4490-486f-b847-72564e948203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:34.396772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae5c994d-4490-486f-b847-72564e948203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:34.426120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:34.512693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c994d-4490-486f-b847-72564e948203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:34.514173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c994d-4490-486f-b847-72564e948203 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:34.533346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 668/1334] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:36.654396 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f5bdd-22ed-4491-90ab-7c72fb7cf99f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:36.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f5bdd-22ed-4491-90ab-7c72fb7cf99f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:36.654971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f5bdd-22ed-4491-90ab-7c72fb7cf99f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:36.656334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 667/1335] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:36.662145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889424ba-4510-4762-a618-7c782ca853cb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:36.662895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889424ba-4510-4762-a618-7c782ca853cb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:36.662998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889424ba-4510-4762-a618-7c782ca853cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:36.732436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-889424ba-4510-4762-a618-7c782ca853cb None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:36.733688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-889424ba-4510-4762-a618-7c782ca853cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:36.812088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:36.838913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 669/1336] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:36.882406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f5bdd-22ed-4491-90ab-7c72fb7cf99f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:36.883952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-929f5bdd-22ed-4491-90ab-7c72fb7cf99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:36.992271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f5bdd-22ed-4491-90ab-7c72fb7cf99f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:37.021393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:37.070464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212577d7-2aab-4d36-b10e-c57bb45a4c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:37.071116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212577d7-2aab-4d36-b10e-c57bb45a4c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:37.071400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212577d7-2aab-4d36-b10e-c57bb45a4c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:37.071678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212577d7-2aab-4d36-b10e-c57bb45a4c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:37.073335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-212577d7-2aab-4d36-b10e-c57bb45a4c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:37.190150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212577d7-2aab-4d36-b10e-c57bb45a4c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:37.191530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212577d7-2aab-4d36-b10e-c57bb45a4c93 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:37.209700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 668/1337] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:39.662957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad0c36-d641-4b18-b845-3b9b2768f194 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:39.663547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad0c36-d641-4b18-b845-3b9b2768f194 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:39.663547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad0c36-d641-4b18-b845-3b9b2768f194 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:39.664921 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 670/1338] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:39.670640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeedf26-7efe-4edc-9dca-1bf6ec4d51ee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:39.671147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeedf26-7efe-4edc-9dca-1bf6ec4d51ee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:39.671247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeedf26-7efe-4edc-9dca-1bf6ec4d51ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:39.744646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-edeedf26-7efe-4edc-9dca-1bf6ec4d51ee None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:39.745923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-edeedf26-7efe-4edc-9dca-1bf6ec4d51ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:39.756069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:39.851568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 669/1339] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:39.888061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad0c36-d641-4b18-b845-3b9b2768f194 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:39.889664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-44ad0c36-d641-4b18-b845-3b9b2768f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:40.016642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad0c36-d641-4b18-b845-3b9b2768f194 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:40.099232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7917c4-0312-4d69-aebe-727f4697c4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:40.099889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7917c4-0312-4d69-aebe-727f4697c4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:40.100176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7917c4-0312-4d69-aebe-727f4697c4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:40.100456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7917c4-0312-4d69-aebe-727f4697c4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:40.102226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be7917c4-0312-4d69-aebe-727f4697c4c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:40.139852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:40.222280 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7917c4-0312-4d69-aebe-727f4697c4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:40.223741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7917c4-0312-4d69-aebe-727f4697c4c9 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:40.244336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 671/1340] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:44.365232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b6cd3-90b6-45e1-88af-21d2319bb435 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:44.365727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b6cd3-90b6-45e1-88af-21d2319bb435 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:44.365845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b6cd3-90b6-45e1-88af-21d2319bb435 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:44.367213 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 670/1341] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:44.372997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd2534-ed1d-48ae-9c84-5d63392d6cd6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:44.373607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd2534-ed1d-48ae-9c84-5d63392d6cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:44.373607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd2534-ed1d-48ae-9c84-5d63392d6cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:44.462607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-04fd2534-ed1d-48ae-9c84-5d63392d6cd6 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:44.463842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04fd2534-ed1d-48ae-9c84-5d63392d6cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:44.574970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:44.593105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 672/1342] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:44.632229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b6cd3-90b6-45e1-88af-21d2319bb435 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:44.634394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-af2b6cd3-90b6-45e1-88af-21d2319bb435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:44.745777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b6cd3-90b6-45e1-88af-21d2319bb435 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:44.749450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025d9cd-5623-4e36-b4ef-280e999970a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:44.750122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025d9cd-5623-4e36-b4ef-280e999970a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:44.750411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025d9cd-5623-4e36-b4ef-280e999970a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:44.751007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025d9cd-5623-4e36-b4ef-280e999970a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:44.761306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025d9cd-5623-4e36-b4ef-280e999970a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:44.762763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025d9cd-5623-4e36-b4ef-280e999970a5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:44.773785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 671/1343] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:47.712158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456554c-a652-43e4-abf7-35e89477ab46 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:47.712723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456554c-a652-43e4-abf7-35e89477ab46 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:47.712723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456554c-a652-43e4-abf7-35e89477ab46 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:47.714380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 673/1344] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:47.720319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcf7a6-734b-4b4b-89d3-8e4ca1d8593f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:47.721018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcf7a6-734b-4b4b-89d3-8e4ca1d8593f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:47.721018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcf7a6-734b-4b4b-89d3-8e4ca1d8593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:47.752622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dbbcf7a6-734b-4b4b-89d3-8e4ca1d8593f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:47.753910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dbbcf7a6-734b-4b4b-89d3-8e4ca1d8593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:47.790598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:05:47.850584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 672/1345] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:47.889099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456554c-a652-43e4-abf7-35e89477ab46 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:47.900407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456554c-a652-43e4-abf7-35e89477ab46 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:47.903989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47f251-827b-4142-8e6a-4bc30dbc7b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:47.904624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f251-827b-4142-8e6a-4bc30dbc7b08 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:47.904903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f251-827b-4142-8e6a-4bc30dbc7b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:47.905178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47f251-827b-4142-8e6a-4bc30dbc7b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:47.915641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47f251-827b-4142-8e6a-4bc30dbc7b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:47.917116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47f251-827b-4142-8e6a-4bc30dbc7b08 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:47.930282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 674/1346] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:52.441511 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f9f25-838c-4959-98bc-224ee94cea19 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:52.442022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f9f25-838c-4959-98bc-224ee94cea19 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:52.442022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f9f25-838c-4959-98bc-224ee94cea19 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:52.443379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 673/1347] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:52.449069 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212d5d-ca00-4a75-a2db-c00b4cc42b59 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:52.449590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212d5d-ca00-4a75-a2db-c00b4cc42b59 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:52.449690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15212d5d-ca00-4a75-a2db-c00b4cc42b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:52.468889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-15212d5d-ca00-4a75-a2db-c00b4cc42b59 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:52.471321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-15212d5d-ca00-4a75-a2db-c00b4cc42b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:52.479502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 675/1348] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:05:52.520776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f9f25-838c-4959-98bc-224ee94cea19 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:05:52.522625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e97f9f25-838c-4959-98bc-224ee94cea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:52.537525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f9f25-838c-4959-98bc-224ee94cea19 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:05:52.542732 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601dde8-b4b9-492b-adee-05d89765a710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:05:52.543428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601dde8-b4b9-492b-adee-05d89765a710 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:52.543718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601dde8-b4b9-492b-adee-05d89765a710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:52.544001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601dde8-b4b9-492b-adee-05d89765a710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:52.554543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601dde8-b4b9-492b-adee-05d89765a710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:05:52.556020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601dde8-b4b9-492b-adee-05d89765a710 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:05:52.567088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 674/1349] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:05:57.851063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b40dd-b765-4d82-8ad7-a8db2901857b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:57.851946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b40dd-b765-4d82-8ad7-a8db2901857b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:57.852392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b40dd-b765-4d82-8ad7-a8db2901857b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:57.853989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 676/1350] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:05:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:05:57.859634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b37ca-f17b-43ce-97e3-d6122ac32b89 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:05:57.861832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b37ca-f17b-43ce-97e3-d6122ac32b89 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:05:57.861832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b37ca-f17b-43ce-97e3-d6122ac32b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:05:57.994264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-730b37ca-f17b-43ce-97e3-d6122ac32b89 None None] MFA Rules not processed for user `5e916fba8123451587f5e13568630015`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:05:57.995877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-730b37ca-f17b-43ce-97e3-d6122ac32b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:05:58.088109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 675/1351] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:02.463708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=13 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:06:03.039930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcbccf-3879-4a92-8826-45c4b5d6e164 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:03.040638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcbccf-3879-4a92-8826-45c4b5d6e164 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:03.041005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcbccf-3879-4a92-8826-45c4b5d6e164 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:03.042546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 677/1352] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:03.048627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815a981-f7a0-4a53-acdc-5da16ac26bbc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:03.049228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815a981-f7a0-4a53-acdc-5da16ac26bbc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:03.049228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815a981-f7a0-4a53-acdc-5da16ac26bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:03.072656 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4815a981-f7a0-4a53-acdc-5da16ac26bbc None None] MFA Rules not processed for user `5e916fba8123451587f5e13568630015`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:03.073968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4815a981-f7a0-4a53-acdc-5da16ac26bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:03.083721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 676/1353] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:04.418027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a6996-138c-4f42-8dec-5341aa72158a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:04.418681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a6996-138c-4f42-8dec-5341aa72158a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:04.418681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a6996-138c-4f42-8dec-5341aa72158a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:04.419937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 678/1354] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:04.425446 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aba13f-7247-4a80-9a2d-509f2a8ae603 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:04.426008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aba13f-7247-4a80-9a2d-509f2a8ae603 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:04.426209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aba13f-7247-4a80-9a2d-509f2a8ae603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:04.445405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-41aba13f-7247-4a80-9a2d-509f2a8ae603 None None] MFA Rules not processed for user `5e916fba8123451587f5e13568630015`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:04.446878 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-41aba13f-7247-4a80-9a2d-509f2a8ae603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:04.458249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 677/1355] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:06:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:08.282947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff46e1-dae4-48b7-a79c-d808dcfe696b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:08.283407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff46e1-dae4-48b7-a79c-d808dcfe696b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:08.283509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff46e1-dae4-48b7-a79c-d808dcfe696b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:08.285050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 679/1356] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:08.291114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdacdf0-d04e-4456-9ff3-537d381b7a82 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:08.291623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdacdf0-d04e-4456-9ff3-537d381b7a82 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:08.291889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdacdf0-d04e-4456-9ff3-537d381b7a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:08.331723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6fdacdf0-d04e-4456-9ff3-537d381b7a82 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:08.332596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6fdacdf0-d04e-4456-9ff3-537d381b7a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:08.344175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 678/1357] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:08.413194 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6fa46-281b-4182-8ea6-0bf485982090 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:08.415043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6fa46-281b-4182-8ea6-0bf485982090 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:08.416092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6fa46-281b-4182-8ea6-0bf485982090 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:08.419077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 680/1358] 10.222.0.90 () {54 vars in 961 bytes} [Tue Jun 21 15:06:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:08.428781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef856d29-bbb5-4ad3-9ec7-68504d94bb26 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:08.429767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef856d29-bbb5-4ad3-9ec7-68504d94bb26 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:08.431098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef856d29-bbb5-4ad3-9ec7-68504d94bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:08.481818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:06:08.492650 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ef856d29-bbb5-4ad3-9ec7-68504d94bb26 None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:08.494477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ef856d29-bbb5-4ad3-9ec7-68504d94bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:08.592043 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 679/1359] 10.222.0.90 () {58 vars in 1058 bytes} [Tue Jun 21 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:08.601014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6fa46-281b-4182-8ea6-0bf485982090 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:08.617720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6fa46-281b-4182-8ea6-0bf485982090 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:08.623422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732d4b9-eb0b-4df2-baa2-42954c852bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:08.624082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732d4b9-eb0b-4df2-baa2-42954c852bc9 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:08.624366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732d4b9-eb0b-4df2-baa2-42954c852bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:08.624646 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732d4b9-eb0b-4df2-baa2-42954c852bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:08.651527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732d4b9-eb0b-4df2-baa2-42954c852bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:08.653452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732d4b9-eb0b-4df2-baa2-42954c852bc9 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:08.665279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 681/1360] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:10.992616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4865896-dc89-4e3a-9c6e-a74cf6ef2f8a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:10.993180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4865896-dc89-4e3a-9c6e-a74cf6ef2f8a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:10.993180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4865896-dc89-4e3a-9c6e-a74cf6ef2f8a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:10.994737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 680/1361] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:06:11.000208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c62ccd-e65f-4606-86da-de60b90fb40f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:11.001649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c62ccd-e65f-4606-86da-de60b90fb40f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:11.001649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c62ccd-e65f-4606-86da-de60b90fb40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:11.020537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-86c62ccd-e65f-4606-86da-de60b90fb40f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:11.021778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-86c62ccd-e65f-4606-86da-de60b90fb40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:11.045841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 682/1362] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:11.076981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4865896-dc89-4e3a-9c6e-a74cf6ef2f8a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:11.092216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4865896-dc89-4e3a-9c6e-a74cf6ef2f8a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:11.098189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcae3d4-ca3f-4852-a988-d6a0dd930bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:11.098828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcae3d4-ca3f-4852-a988-d6a0dd930bdc service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:11.099127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcae3d4-ca3f-4852-a988-d6a0dd930bdc service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:11.099389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcae3d4-ca3f-4852-a988-d6a0dd930bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:11.109446 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcae3d4-ca3f-4852-a988-d6a0dd930bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:11.111759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcae3d4-ca3f-4852-a988-d6a0dd930bdc service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:11.122915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 681/1363] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:13.632658 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db5f11-10bc-4b27-99b2-ef42018cb099 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:13.633156 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db5f11-10bc-4b27-99b2-ef42018cb099 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:13.633274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db5f11-10bc-4b27-99b2-ef42018cb099 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:13.634936 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 683/1364] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:13.640433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601ad17-1072-4bfe-8ebb-7058fd14d7a0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:13.640914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601ad17-1072-4bfe-8ebb-7058fd14d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:13.640914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601ad17-1072-4bfe-8ebb-7058fd14d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:13.660438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a601ad17-1072-4bfe-8ebb-7058fd14d7a0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:13.662221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a601ad17-1072-4bfe-8ebb-7058fd14d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:13.676656 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 682/1365] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:06:13.741216 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae5879-576c-49c2-912d-d7cad2db498c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:13.741520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae5879-576c-49c2-912d-d7cad2db498c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:13.741847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae5879-576c-49c2-912d-d7cad2db498c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:13.743498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 684/1366] 10.222.0.90 () {54 vars in 961 bytes} [Tue Jun 21 15:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:13.751029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2307d-cc44-46aa-9fd9-5bb5d496b300 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:13.751410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2307d-cc44-46aa-9fd9-5bb5d496b300 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:13.751691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2307d-cc44-46aa-9fd9-5bb5d496b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:13.772302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f2e2307d-cc44-46aa-9fd9-5bb5d496b300 None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:13.773718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f2e2307d-cc44-46aa-9fd9-5bb5d496b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:13.783709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 683/1367] 10.222.0.90 () {58 vars in 1058 bytes} [Tue Jun 21 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:13.791829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae5879-576c-49c2-912d-d7cad2db498c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:13.806861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae5879-576c-49c2-912d-d7cad2db498c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:13.812478 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1828d-01a8-428b-ab66-2a58b08b233f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:13.813698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1828d-01a8-428b-ab66-2a58b08b233f service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:13.813969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1828d-01a8-428b-ab66-2a58b08b233f service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:13.814243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1828d-01a8-428b-ab66-2a58b08b233f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:13.823328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1828d-01a8-428b-ab66-2a58b08b233f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:13.825046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1828d-01a8-428b-ab66-2a58b08b233f service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:13.838072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 685/1368] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:16.033994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2692-d576-4dc0-9eb0-0da53799eefe None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:16.034719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2692-d576-4dc0-9eb0-0da53799eefe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:16.034719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2692-d576-4dc0-9eb0-0da53799eefe None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:16.036133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 684/1369] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:06:16.042188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936946c9-badd-4b15-83e4-5d6263499bc4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:16.042682 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936946c9-badd-4b15-83e4-5d6263499bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:16.042805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936946c9-badd-4b15-83e4-5d6263499bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:16.061150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-936946c9-badd-4b15-83e4-5d6263499bc4 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:16.062389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-936946c9-badd-4b15-83e4-5d6263499bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:16.075102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 686/1370] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:16.129533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2692-d576-4dc0-9eb0-0da53799eefe None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:16.145460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2692-d576-4dc0-9eb0-0da53799eefe None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:16.151516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303db3e-4940-4100-9b07-5ba202ccd9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:16.152377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303db3e-4940-4100-9b07-5ba202ccd9d7 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:16.152816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303db3e-4940-4100-9b07-5ba202ccd9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:16.153245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303db3e-4940-4100-9b07-5ba202ccd9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:16.163477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303db3e-4940-4100-9b07-5ba202ccd9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:16.165399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303db3e-4940-4100-9b07-5ba202ccd9d7 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:16.177250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 685/1371] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:16.874422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19ac2-c675-42f6-addc-75c564689fdd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:16.874710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19ac2-c675-42f6-addc-75c564689fdd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:16.875184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19ac2-c675-42f6-addc-75c564689fdd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:16.876611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 687/1372] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:16.882340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23efa5-92e2-4b86-b75d-79a283c85b97 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:16.882636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23efa5-92e2-4b86-b75d-79a283c85b97 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:16.882917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23efa5-92e2-4b86-b75d-79a283c85b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:16.903726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ea23efa5-92e2-4b86-b75d-79a283c85b97 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:16.905118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ea23efa5-92e2-4b86-b75d-79a283c85b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:16.932233 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 686/1373] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:17.274324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff248f-25b0-40be-8298-5f37a458e07e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:17.274912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff248f-25b0-40be-8298-5f37a458e07e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:17.275285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff248f-25b0-40be-8298-5f37a458e07e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:17.277741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 688/1374] 10.222.0.90 () {54 vars in 963 bytes} [Tue Jun 21 15:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:17.284651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aafef3-1235-4e20-8a6f-5e3025cac628 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:17.285227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aafef3-1235-4e20-8a6f-5e3025cac628 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:17.285619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aafef3-1235-4e20-8a6f-5e3025cac628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:17.355294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8aafef3-1235-4e20-8a6f-5e3025cac628 None None] MFA Rules not processed for user `b480c19eb6ec42979a81ad274acb1f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:17.356506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8aafef3-1235-4e20-8a6f-5e3025cac628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:17.428371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 687/1375] 10.222.0.90 () {58 vars in 1060 bytes} [Tue Jun 21 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:06:17.439414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff248f-25b0-40be-8298-5f37a458e07e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:17.450705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff248f-25b0-40be-8298-5f37a458e07e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:17.455486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88b1fd-89b3-43c0-9b48-135740cb0e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:17.456142 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88b1fd-89b3-43c0-9b48-135740cb0e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:17.456434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88b1fd-89b3-43c0-9b48-135740cb0e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:17.456714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88b1fd-89b3-43c0-9b48-135740cb0e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:17.466642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88b1fd-89b3-43c0-9b48-135740cb0e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:17.468100 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88b1fd-89b3-43c0-9b48-135740cb0e0b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:17.479334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 689/1376] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:18.354551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1bb2-5c3d-435f-99e8-2987d697ed0e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:18.355881 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1bb2-5c3d-435f-99e8-2987d697ed0e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:18.356567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1bb2-5c3d-435f-99e8-2987d697ed0e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:18.361948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 688/1377] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:18.365606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a15e-3c97-477f-a0bc-2f542ba63c6a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:18.366031 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a15e-3c97-477f-a0bc-2f542ba63c6a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:18.366407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a15e-3c97-477f-a0bc-2f542ba63c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:18.390999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3619a15e-3c97-477f-a0bc-2f542ba63c6a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:18.392387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3619a15e-3c97-477f-a0bc-2f542ba63c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:18.414025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 690/1378] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:18.470837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1bb2-5c3d-435f-99e8-2987d697ed0e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:18.493059 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1bb2-5c3d-435f-99e8-2987d697ed0e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:18.498533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa7c2c-6af2-4723-ab95-116d2df1f3ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:18.499185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa7c2c-6af2-4723-ab95-116d2df1f3ad service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:18.499470 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa7c2c-6af2-4723-ab95-116d2df1f3ad service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:18.499765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa7c2c-6af2-4723-ab95-116d2df1f3ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:18.509502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa7c2c-6af2-4723-ab95-116d2df1f3ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:18.511122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa7c2c-6af2-4723-ab95-116d2df1f3ad service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:18.516006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:06:18.523490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 689/1379] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:20.660299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64494a4-34bf-4a54-aae7-d13feca6061e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:20.660820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64494a4-34bf-4a54-aae7-d13feca6061e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:20.660820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64494a4-34bf-4a54-aae7-d13feca6061e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:20.662413 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 691/1380] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:20.667608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5e782-361d-4bb0-aadd-cb40c7a52bb5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:20.668074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5e782-361d-4bb0-aadd-cb40c7a52bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:20.668175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5e782-361d-4bb0-aadd-cb40c7a52bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:20.687436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8ec5e782-361d-4bb0-aadd-cb40c7a52bb5 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:20.689464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8ec5e782-361d-4bb0-aadd-cb40c7a52bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:20.697453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 690/1381] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:20.742341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64494a4-34bf-4a54-aae7-d13feca6061e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:20.757198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64494a4-34bf-4a54-aae7-d13feca6061e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:20.762685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845c386-967d-47dc-b244-7d855c274cfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:20.763325 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845c386-967d-47dc-b244-7d855c274cfe service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:20.763605 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845c386-967d-47dc-b244-7d855c274cfe service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:20.763875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845c386-967d-47dc-b244-7d855c274cfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:20.772599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845c386-967d-47dc-b244-7d855c274cfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:20.774224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845c386-967d-47dc-b244-7d855c274cfe service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:20.784292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 692/1382] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:23.137600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dee36-fe61-4486-a74e-4830b2e57a06 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:23.138493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dee36-fe61-4486-a74e-4830b2e57a06 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:23.138493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dee36-fe61-4486-a74e-4830b2e57a06 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:23.139855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 691/1383] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:23.146940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe19a2-c1a3-4c8e-83e8-8955f75c7965 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:23.147460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe19a2-c1a3-4c8e-83e8-8955f75c7965 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:23.147569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe19a2-c1a3-4c8e-83e8-8955f75c7965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:23.167391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-17fe19a2-c1a3-4c8e-83e8-8955f75c7965 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:23.168623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-17fe19a2-c1a3-4c8e-83e8-8955f75c7965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:23.180717 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 693/1384] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:06:23.226002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dee36-fe61-4486-a74e-4830b2e57a06 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:23.241404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dee36-fe61-4486-a74e-4830b2e57a06 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:23.253614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82523-9d6a-4f58-8028-84c7ffce59ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:23.254255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82523-9d6a-4f58-8028-84c7ffce59ff service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:23.254535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82523-9d6a-4f58-8028-84c7ffce59ff service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:23.255105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82523-9d6a-4f58-8028-84c7ffce59ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:23.267540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f82523-9d6a-4f58-8028-84c7ffce59ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:23.269153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f82523-9d6a-4f58-8028-84c7ffce59ff service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:23.280445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 692/1385] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:25.473582 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948067c3-4b32-4489-88e0-3484d686bfa0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:25.474172 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948067c3-4b32-4489-88e0-3484d686bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:25.474587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948067c3-4b32-4489-88e0-3484d686bfa0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:25.476051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 694/1386] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:25.482754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df4218-3aa4-4db9-9ead-3ca9c85e08e8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:25.483237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df4218-3aa4-4db9-9ead-3ca9c85e08e8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:25.483336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df4218-3aa4-4db9-9ead-3ca9c85e08e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:25.503652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b9df4218-3aa4-4db9-9ead-3ca9c85e08e8 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:25.504930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b9df4218-3aa4-4db9-9ead-3ca9c85e08e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:25.513493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 693/1387] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:25.561172 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948067c3-4b32-4489-88e0-3484d686bfa0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:25.576412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948067c3-4b32-4489-88e0-3484d686bfa0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:25.582772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542797a-45e1-4ee3-859c-a357c82d651f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:25.583432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542797a-45e1-4ee3-859c-a357c82d651f service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:25.583729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542797a-45e1-4ee3-859c-a357c82d651f service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:25.583994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542797a-45e1-4ee3-859c-a357c82d651f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:25.596285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542797a-45e1-4ee3-859c-a357c82d651f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:25.597918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542797a-45e1-4ee3-859c-a357c82d651f service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:25.609319 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 695/1388] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:27.738019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d019d-8404-43d4-a97b-faa85081e240 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:27.738801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d019d-8404-43d4-a97b-faa85081e240 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:27.738801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d019d-8404-43d4-a97b-faa85081e240 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:27.739979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 694/1389] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:27.746723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99323c-aa0e-4a54-ac37-e987df33a4a0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:27.747239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99323c-aa0e-4a54-ac37-e987df33a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:27.747645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99323c-aa0e-4a54-ac37-e987df33a4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:27.769943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6c99323c-aa0e-4a54-ac37-e987df33a4a0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:27.771251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6c99323c-aa0e-4a54-ac37-e987df33a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:27.779510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 696/1390] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:27.826972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d019d-8404-43d4-a97b-faa85081e240 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:27.848399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d019d-8404-43d4-a97b-faa85081e240 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:27.855304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac17fb-7969-4bdf-9b87-3abaab611d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:27.856095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac17fb-7969-4bdf-9b87-3abaab611d08 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:27.856387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac17fb-7969-4bdf-9b87-3abaab611d08 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:27.856670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac17fb-7969-4bdf-9b87-3abaab611d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:27.868609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac17fb-7969-4bdf-9b87-3abaab611d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:27.870269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac17fb-7969-4bdf-9b87-3abaab611d08 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:27.881164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 695/1391] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:06:30.447394 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0729a5-1ded-4da3-838b-83bc9a0828db None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:30.448083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0729a5-1ded-4da3-838b-83bc9a0828db None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:30.448083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0729a5-1ded-4da3-838b-83bc9a0828db None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:30.449820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 697/1392] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:30.456548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1eb21-eb55-4319-b663-fc3e7bff6acc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:30.457198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1eb21-eb55-4319-b663-fc3e7bff6acc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:30.457198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1eb21-eb55-4319-b663-fc3e7bff6acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:30.476521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e5b1eb21-eb55-4319-b663-fc3e7bff6acc None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:30.477800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5b1eb21-eb55-4319-b663-fc3e7bff6acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:30.488401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 696/1393] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:30.541896 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0729a5-1ded-4da3-838b-83bc9a0828db None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:30.559260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0729a5-1ded-4da3-838b-83bc9a0828db None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:30.565971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9710d7-e357-4350-918c-36bf70e4682b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:30.566757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9710d7-e357-4350-918c-36bf70e4682b service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:30.567111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9710d7-e357-4350-918c-36bf70e4682b service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:30.567478 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9710d7-e357-4350-918c-36bf70e4682b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:30.578964 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9710d7-e357-4350-918c-36bf70e4682b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:30.580980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9710d7-e357-4350-918c-36bf70e4682b service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:30.594350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 698/1394] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:32.762964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23c95-49b7-4fa6-9324-60d5b0995aa8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:32.763541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23c95-49b7-4fa6-9324-60d5b0995aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:32.763541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f23c95-49b7-4fa6-9324-60d5b0995aa8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:32.764911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 697/1395] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:06:32.770687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76af50-b968-4112-b212-63800e2b9a12 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:32.771206 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76af50-b968-4112-b212-63800e2b9a12 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:32.771389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76af50-b968-4112-b212-63800e2b9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:32.777309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=52 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:06:32.790643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1a76af50-b968-4112-b212-63800e2b9a12 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:32.791828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a76af50-b968-4112-b212-63800e2b9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:32.800328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 699/1396] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:32.844960 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f23c95-49b7-4fa6-9324-60d5b0995aa8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:32.860276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f23c95-49b7-4fa6-9324-60d5b0995aa8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:32.865948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf67e6f-e320-4c14-b469-db97f6885640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:32.866585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf67e6f-e320-4c14-b469-db97f6885640 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:32.866866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf67e6f-e320-4c14-b469-db97f6885640 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:32.867140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf67e6f-e320-4c14-b469-db97f6885640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:32.876581 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf67e6f-e320-4c14-b469-db97f6885640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:32.877994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf67e6f-e320-4c14-b469-db97f6885640 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:32.887914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 698/1397] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:06:33.276296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbdcfc-5b94-4bf4-9c65-d4afa018bf8a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:33.276762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbdcfc-5b94-4bf4-9c65-d4afa018bf8a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:33.277170 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbdcfc-5b94-4bf4-9c65-d4afa018bf8a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:33.278701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 700/1398] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:33.284816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2625d6-238c-4787-bdf5-8552f0ed1671 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:33.285111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2625d6-238c-4787-bdf5-8552f0ed1671 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:33.285394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2625d6-238c-4787-bdf5-8552f0ed1671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:33.306216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9e2625d6-238c-4787-bdf5-8552f0ed1671 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:33.307429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9e2625d6-238c-4787-bdf5-8552f0ed1671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:33.315763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 699/1399] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:33.374791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e72e0a-a271-4112-81d2-9188cee4fd29 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:33.375180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e72e0a-a271-4112-81d2-9188cee4fd29 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:33.375465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e72e0a-a271-4112-81d2-9188cee4fd29 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:33.376820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 701/1400] 10.222.0.90 () {54 vars in 962 bytes} [Tue Jun 21 15:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:33.381829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008806c-d7ec-4d18-b4d2-5ec1d689d916 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:33.382198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008806c-d7ec-4d18-b4d2-5ec1d689d916 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:33.382546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008806c-d7ec-4d18-b4d2-5ec1d689d916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:33.433640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a008806c-d7ec-4d18-b4d2-5ec1d689d916 None None] MFA Rules not processed for user `27ac2738bf434afabe3d227dc5e52650`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:33.434854 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a008806c-d7ec-4d18-b4d2-5ec1d689d916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:33.497163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 700/1401] 10.222.0.90 () {58 vars in 1059 bytes} [Tue Jun 21 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:33.504852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e72e0a-a271-4112-81d2-9188cee4fd29 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:33.516202 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e72e0a-a271-4112-81d2-9188cee4fd29 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:33.520212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bd37f-ad56-497d-bb84-edbc938f2164 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ac2738bf434afabe3d227dc5e52650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:33.520850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bd37f-ad56-497d-bb84-edbc938f2164 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:33.521137 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bd37f-ad56-497d-bb84-edbc938f2164 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:33.521417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bd37f-ad56-497d-bb84-edbc938f2164 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:33.530901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bd37f-ad56-497d-bb84-edbc938f2164 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:33.532987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bd37f-ad56-497d-bb84-edbc938f2164 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:33.556459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 702/1402] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:34.310501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4fad3-6b87-42c8-87e8-a9274d176220 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:34.311008 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4fad3-6b87-42c8-87e8-a9274d176220 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:34.311110 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4fad3-6b87-42c8-87e8-a9274d176220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:34.367369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cac4fad3-6b87-42c8-87e8-a9274d176220 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:34.368733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cac4fad3-6b87-42c8-87e8-a9274d176220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:34.413803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:06:34.439748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 701/1403] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:34.485658 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f7bdc-9e20-4dfd-b008-450dcf3a02d1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:34.486159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f7bdc-9e20-4dfd-b008-450dcf3a02d1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:34.486379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f7bdc-9e20-4dfd-b008-450dcf3a02d1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:34.487853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 703/1404] 10.222.0.90 () {54 vars in 942 bytes} [Tue Jun 21 15:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:34.494595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cecfe-4dd3-4713-8068-4254e13be840 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:34.494952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cecfe-4dd3-4713-8068-4254e13be840 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:34.495297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cecfe-4dd3-4713-8068-4254e13be840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:34.548949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-177cecfe-4dd3-4713-8068-4254e13be840 None None] MFA Rules not processed for user `8ebffb0a0cf04bc0809a94ddd3a347b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:34.550416 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-177cecfe-4dd3-4713-8068-4254e13be840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:34.627353 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 702/1405] 10.222.0.90 () {58 vars in 1039 bytes} [Tue Jun 21 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:06:34.636454 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f7bdc-9e20-4dfd-b008-450dcf3a02d1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:34.651343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f7bdc-9e20-4dfd-b008-450dcf3a02d1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:34.656852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c186538-5eb6-4636-96cf-ab49f95a80d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:34.657526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c186538-5eb6-4636-96cf-ab49f95a80d1 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:34.657817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c186538-5eb6-4636-96cf-ab49f95a80d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:34.658099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c186538-5eb6-4636-96cf-ab49f95a80d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:34.667230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c186538-5eb6-4636-96cf-ab49f95a80d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:34.668813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c186538-5eb6-4636-96cf-ab49f95a80d1 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:34.679362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 704/1406] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:06:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:06:35.010705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad09166-9bfd-4125-8022-74b2d851d9d6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:35.010948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad09166-9bfd-4125-8022-74b2d851d9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:35.011194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad09166-9bfd-4125-8022-74b2d851d9d6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:35.012552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 703/1407] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:35.018235 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b9f17-33fb-4629-8320-f692f91b6343 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:35.018522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b9f17-33fb-4629-8320-f692f91b6343 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:35.018801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b9f17-33fb-4629-8320-f692f91b6343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:35.040786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b65b9f17-33fb-4629-8320-f692f91b6343 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:35.042033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b65b9f17-33fb-4629-8320-f692f91b6343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:35.051181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 705/1408] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:35.101626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad09166-9bfd-4125-8022-74b2d851d9d6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:06:35.133392 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad09166-9bfd-4125-8022-74b2d851d9d6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:06:35.139170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950531e3-db76-4a3d-8056-345034f4d0b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:06:35.139816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950531e3-db76-4a3d-8056-345034f4d0b3 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:35.140100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950531e3-db76-4a3d-8056-345034f4d0b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:35.141290 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950531e3-db76-4a3d-8056-345034f4d0b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:35.150844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950531e3-db76-4a3d-8056-345034f4d0b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:06:35.152450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950531e3-db76-4a3d-8056-345034f4d0b3 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:06:35.167384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 704/1409] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:06:45.035440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=17 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:06:45.160322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=59 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:06:57.928431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0a2e5-a3ba-4fad-8ffb-4675f9ccd858 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:57.928953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0a2e5-a3ba-4fad-8ffb-4675f9ccd858 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:57.928953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0a2e5-a3ba-4fad-8ffb-4675f9ccd858 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:57.930315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 706/1410] 10.222.0.90 () {54 vars in 918 bytes} [Tue Jun 21 15:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:06:57.935590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31b3f-b58c-4b25-b86c-2db005357f43 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:57.936021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31b3f-b58c-4b25-b86c-2db005357f43 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:57.936137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31b3f-b58c-4b25-b86c-2db005357f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:57.955236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f8e31b3f-b58c-4b25-b86c-2db005357f43 None None] MFA Rules not processed for user `5e916fba8123451587f5e13568630015`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:57.956426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8e31b3f-b58c-4b25-b86c-2db005357f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:57.964940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 705/1411] 10.222.0.90 () {58 vars in 1015 bytes} [Tue Jun 21 15:06:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:06:57.979262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce1c5b-f52b-4668-9c47-ffad9d240b25 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:57.979549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce1c5b-f52b-4668-9c47-ffad9d240b25 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:57.979827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce1c5b-f52b-4668-9c47-ffad9d240b25 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:57.981192 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 707/1412] 10.222.0.90 () {54 vars in 918 bytes} [Tue Jun 21 15:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:06:57.985945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e734b8a-32be-4d51-a6d3-2b51caa317df None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:06:57.986237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e734b8a-32be-4d51-a6d3-2b51caa317df None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:06:57.986523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e734b8a-32be-4d51-a6d3-2b51caa317df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:06:58.005432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4e734b8a-32be-4d51-a6d3-2b51caa317df None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:06:58.006662 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4e734b8a-32be-4d51-a6d3-2b51caa317df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:06:58.016939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 706/1413] 10.222.0.90 () {58 vars in 1015 bytes} [Tue Jun 21 15:06:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:00.604258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4d5e-8c4e-44fd-a7e4-72eb000af564 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:00.604815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4d5e-8c4e-44fd-a7e4-72eb000af564 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:00.604815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4d5e-8c4e-44fd-a7e4-72eb000af564 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:00.606220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:00.612827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72814-d75b-40b7-867a-a79a6caa99db None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:00.613356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72814-d75b-40b7-867a-a79a6caa99db None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:00.613356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72814-d75b-40b7-867a-a79a6caa99db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:00.634111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1af72814-d75b-40b7-867a-a79a6caa99db None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:00.635636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1af72814-d75b-40b7-867a-a79a6caa99db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:00.646598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:07:00.692824 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4d5e-8c4e-44fd-a7e4-72eb000af564 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:00.708730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4d5e-8c4e-44fd-a7e4-72eb000af564 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:00.714060 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936b037-9569-49bc-983c-54693b5e8406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:00.714697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936b037-9569-49bc-983c-54693b5e8406 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:00.714977 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936b037-9569-49bc-983c-54693b5e8406 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:00.715250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936b037-9569-49bc-983c-54693b5e8406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:00.723746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936b037-9569-49bc-983c-54693b5e8406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:00.725311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936b037-9569-49bc-983c-54693b5e8406 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:00.734962 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 709/1416] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:01.658700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532773e7-bfc0-4b9b-9b67-fb36a3021b87 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:01.659242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532773e7-bfc0-4b9b-9b67-fb36a3021b87 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:01.659242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532773e7-bfc0-4b9b-9b67-fb36a3021b87 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:01.660642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:01.666087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48636-809b-4ce7-811f-e024c1ec4648 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:01.666512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48636-809b-4ce7-811f-e024c1ec4648 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:01.666686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d48636-809b-4ce7-811f-e024c1ec4648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:01.684943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-56d48636-809b-4ce7-811f-e024c1ec4648 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:01.686177 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-56d48636-809b-4ce7-811f-e024c1ec4648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:01.694076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:01.856593 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532773e7-bfc0-4b9b-9b67-fb36a3021b87 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:01.871269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532773e7-bfc0-4b9b-9b67-fb36a3021b87 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:01.876823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f5649-2de7-478a-9c8a-65b9d4c1d2a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:01.877490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f5649-2de7-478a-9c8a-65b9d4c1d2a0 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:01.877850 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f5649-2de7-478a-9c8a-65b9d4c1d2a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:01.878131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f5649-2de7-478a-9c8a-65b9d4c1d2a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:01.886693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f5649-2de7-478a-9c8a-65b9d4c1d2a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:01.888275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f5649-2de7-478a-9c8a-65b9d4c1d2a0 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:01.898386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 709/1419] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:02.945859 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31575f5-41dd-4ac7-b5be-15b7d22eeb98 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:02.946420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31575f5-41dd-4ac7-b5be-15b7d22eeb98 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:02.946540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31575f5-41dd-4ac7-b5be-15b7d22eeb98 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:02.947848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:02.953094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4622-60c9-4ec6-aa66-5d874126ef6a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:02.953564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4622-60c9-4ec6-aa66-5d874126ef6a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:02.953673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4622-60c9-4ec6-aa66-5d874126ef6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:02.975076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-56fd4622-60c9-4ec6-aa66-5d874126ef6a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:02.976296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-56fd4622-60c9-4ec6-aa66-5d874126ef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:02.986257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:03.154181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31575f5-41dd-4ac7-b5be-15b7d22eeb98 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:03.170647 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31575f5-41dd-4ac7-b5be-15b7d22eeb98 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:03.177565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a004-f594-4eba-baea-da519860e790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:03.178218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a004-f594-4eba-baea-da519860e790 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:03.178531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a004-f594-4eba-baea-da519860e790 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:03.178812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a004-f594-4eba-baea-da519860e790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:03.188217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a004-f594-4eba-baea-da519860e790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:03.189776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a004-f594-4eba-baea-da519860e790 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:03.199494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 712/1422] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:04.083673 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbb564-d826-443a-94b3-bba25d3b027d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:04.084246 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbb564-d826-443a-94b3-bba25d3b027d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:04.084246 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbb564-d826-443a-94b3-bba25d3b027d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:04.085652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:04.090782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73e69-c7d9-4832-b662-0f94e1f8e8c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:04.091263 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73e69-c7d9-4832-b662-0f94e1f8e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:04.091369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73e69-c7d9-4832-b662-0f94e1f8e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:04.110550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-99d73e69-c7d9-4832-b662-0f94e1f8e8c0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:04.111784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-99d73e69-c7d9-4832-b662-0f94e1f8e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:04.119812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:04.271437 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbb564-d826-443a-94b3-bba25d3b027d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:04.286958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbb564-d826-443a-94b3-bba25d3b027d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:04.292252 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c9718-0189-4272-854d-e80013edfc27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:04.292898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c9718-0189-4272-854d-e80013edfc27 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:04.293174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c9718-0189-4272-854d-e80013edfc27 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:04.293448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c9718-0189-4272-854d-e80013edfc27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:04.302545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c9718-0189-4272-854d-e80013edfc27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:04.304165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c9718-0189-4272-854d-e80013edfc27 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:04.314514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 712/1425] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:05.186500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8cf2-f19e-47a4-8b6c-9da5180621e9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:05.187530 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8cf2-f19e-47a4-8b6c-9da5180621e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:05.188065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8cf2-f19e-47a4-8b6c-9da5180621e9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:05.189457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:07:05.194831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ce0e-122b-40c4-b2a1-c92f470bc456 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:05.195349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ce0e-122b-40c4-b2a1-c92f470bc456 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:05.195460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ce0e-122b-40c4-b2a1-c92f470bc456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:05.214980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b832ce0e-122b-40c4-b2a1-c92f470bc456 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:05.216209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b832ce0e-122b-40c4-b2a1-c92f470bc456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:05.224616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:05.377014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8cf2-f19e-47a4-8b6c-9da5180621e9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:05.392508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8cf2-f19e-47a4-8b6c-9da5180621e9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:05.398862 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9762eb-e85d-40fe-b48a-d9796560d8f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:05.399505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9762eb-e85d-40fe-b48a-d9796560d8f7 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:05.399793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9762eb-e85d-40fe-b48a-d9796560d8f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:05.400075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9762eb-e85d-40fe-b48a-d9796560d8f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:05.409033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9762eb-e85d-40fe-b48a-d9796560d8f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:05.410645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9762eb-e85d-40fe-b48a-d9796560d8f7 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:05.420342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 715/1428] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:06.245264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2fcd-3cde-4aaf-be3b-64a12cda8acc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:06.245814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2fcd-3cde-4aaf-be3b-64a12cda8acc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:06.245814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2fcd-3cde-4aaf-be3b-64a12cda8acc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:06.247206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:06.252723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d714d0-c83f-47b6-b8ac-9bf9dd2b5307 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:06.253170 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d714d0-c83f-47b6-b8ac-9bf9dd2b5307 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:06.253286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d714d0-c83f-47b6-b8ac-9bf9dd2b5307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:06.271554 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-46d714d0-c83f-47b6-b8ac-9bf9dd2b5307 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:06.272771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46d714d0-c83f-47b6-b8ac-9bf9dd2b5307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:06.281452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:06.433154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2fcd-3cde-4aaf-be3b-64a12cda8acc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:06.448124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2fcd-3cde-4aaf-be3b-64a12cda8acc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:06.453756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd221c95-2d1e-4c71-b815-50b9e0a8fe1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:06.454389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd221c95-2d1e-4c71-b815-50b9e0a8fe1a service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:06.454670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd221c95-2d1e-4c71-b815-50b9e0a8fe1a service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:06.454944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd221c95-2d1e-4c71-b815-50b9e0a8fe1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:06.463049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd221c95-2d1e-4c71-b815-50b9e0a8fe1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:06.464616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd221c95-2d1e-4c71-b815-50b9e0a8fe1a service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:06.474451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 715/1431] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:07.279278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783387-34c0-40ee-9014-45dc3e8e35d2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:07.279882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783387-34c0-40ee-9014-45dc3e8e35d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:07.279882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783387-34c0-40ee-9014-45dc3e8e35d2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:07.281244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:07.287394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b32c5-a964-4066-9795-894fe7046f69 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:07.287846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b32c5-a964-4066-9795-894fe7046f69 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:07.287982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b32c5-a964-4066-9795-894fe7046f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:07.306368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a86b32c5-a964-4066-9795-894fe7046f69 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:07.307569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a86b32c5-a964-4066-9795-894fe7046f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:07.315569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:07.472288 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32783387-34c0-40ee-9014-45dc3e8e35d2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:07.486448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32783387-34c0-40ee-9014-45dc3e8e35d2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:07.491723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e2ecb-e957-4147-a314-331cb7f17f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:07.492345 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e2ecb-e957-4147-a314-331cb7f17f10 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:07.492622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e2ecb-e957-4147-a314-331cb7f17f10 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:07.492893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e2ecb-e957-4147-a314-331cb7f17f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:07.501971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e2ecb-e957-4147-a314-331cb7f17f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:07.503528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e2ecb-e957-4147-a314-331cb7f17f10 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:07.512757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 718/1434] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:08.372087 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4533052-dd16-4830-a051-d713c1ab9d20 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:08.372666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4533052-dd16-4830-a051-d713c1ab9d20 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:08.372666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4533052-dd16-4830-a051-d713c1ab9d20 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:08.374103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:08.379476 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c86f8-e5e0-477d-8b7d-1637cde38050 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:08.379949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c86f8-e5e0-477d-8b7d-1637cde38050 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:08.380051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c86f8-e5e0-477d-8b7d-1637cde38050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:08.398675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7c0c86f8-e5e0-477d-8b7d-1637cde38050 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:08.399894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7c0c86f8-e5e0-477d-8b7d-1637cde38050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:08.408722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:08.559337 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4533052-dd16-4830-a051-d713c1ab9d20 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:08.573910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4533052-dd16-4830-a051-d713c1ab9d20 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:08.579973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd9ec2-5cb7-4f07-ae71-b3115ac95146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:08.580604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd9ec2-5cb7-4f07-ae71-b3115ac95146 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:08.580886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd9ec2-5cb7-4f07-ae71-b3115ac95146 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:08.581158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd9ec2-5cb7-4f07-ae71-b3115ac95146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:08.589297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd9ec2-5cb7-4f07-ae71-b3115ac95146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:08.590893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd9ec2-5cb7-4f07-ae71-b3115ac95146 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:08.600999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 718/1437] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:09.423687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b38160-1dfa-4cbd-8868-740b3ede1600 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:09.424268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b38160-1dfa-4cbd-8868-740b3ede1600 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:09.424268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b38160-1dfa-4cbd-8868-740b3ede1600 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:09.425633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:09.430858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08cd2-56cd-449d-8c7e-69d6c1f425a5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:09.431521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08cd2-56cd-449d-8c7e-69d6c1f425a5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:09.431521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08cd2-56cd-449d-8c7e-69d6c1f425a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:09.449734 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f3e08cd2-56cd-449d-8c7e-69d6c1f425a5 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:09.450940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3e08cd2-56cd-449d-8c7e-69d6c1f425a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:09.459814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:09.611147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b38160-1dfa-4cbd-8868-740b3ede1600 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:09.626820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b38160-1dfa-4cbd-8868-740b3ede1600 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:09.632240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18446cf5-eddf-4074-ae9d-1188d6331f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:09.632908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18446cf5-eddf-4074-ae9d-1188d6331f7b service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:09.633177 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18446cf5-eddf-4074-ae9d-1188d6331f7b service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:09.633458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18446cf5-eddf-4074-ae9d-1188d6331f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:09.643002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18446cf5-eddf-4074-ae9d-1188d6331f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:09.644592 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18446cf5-eddf-4074-ae9d-1188d6331f7b service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:09.657769 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 721/1440] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:11.644912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1208c-e2d0-462f-a040-d96382b1d51b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:11.645825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1208c-e2d0-462f-a040-d96382b1d51b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:11.646020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1208c-e2d0-462f-a040-d96382b1d51b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:11.647845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:11.653301 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1e8f-d3a8-4f67-8783-387b7e87573a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:11.653817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1e8f-d3a8-4f67-8783-387b7e87573a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:11.653974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1e8f-d3a8-4f67-8783-387b7e87573a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:11.674959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7add1e8f-d3a8-4f67-8783-387b7e87573a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:11.676178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7add1e8f-d3a8-4f67-8783-387b7e87573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:11.685413 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:11.733208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1208c-e2d0-462f-a040-d96382b1d51b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:11.744879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1208c-e2d0-462f-a040-d96382b1d51b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:11.748801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627d849-01a7-4a61-b307-a68112267e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:11.749596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627d849-01a7-4a61-b307-a68112267e0f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:11.750429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627d849-01a7-4a61-b307-a68112267e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:11.750894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627d849-01a7-4a61-b307-a68112267e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:11.760983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627d849-01a7-4a61-b307-a68112267e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:11.762448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627d849-01a7-4a61-b307-a68112267e0f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:11.774208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 721/1443] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:14.015690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf0e3a-73fb-449c-85fa-606cac8ccdbd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:14.016258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf0e3a-73fb-449c-85fa-606cac8ccdbd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:14.016258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf0e3a-73fb-449c-85fa-606cac8ccdbd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:14.017609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:14.023247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25288a2-01d2-4f1d-944f-fe6026f342c2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:14.023939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25288a2-01d2-4f1d-944f-fe6026f342c2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:14.023939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25288a2-01d2-4f1d-944f-fe6026f342c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:14.041797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e25288a2-01d2-4f1d-944f-fe6026f342c2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:14.042992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e25288a2-01d2-4f1d-944f-fe6026f342c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:14.051746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:14.091694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf0e3a-73fb-449c-85fa-606cac8ccdbd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:14.103343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf0e3a-73fb-449c-85fa-606cac8ccdbd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:14.106801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2084-dcc9-43d8-bdd5-4a9b2d02f665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:14.107425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2084-dcc9-43d8-bdd5-4a9b2d02f665 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:14.107705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2084-dcc9-43d8-bdd5-4a9b2d02f665 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:14.107985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2084-dcc9-43d8-bdd5-4a9b2d02f665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:14.117415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2084-dcc9-43d8-bdd5-4a9b2d02f665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:14.118852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2084-dcc9-43d8-bdd5-4a9b2d02f665 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:14.128784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 724/1446] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:16.621428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857663e-c735-4977-8816-08823304e7c0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:16.622020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857663e-c735-4977-8816-08823304e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:16.622020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857663e-c735-4977-8816-08823304e7c0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:16.623436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:16.629603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79eadc-cdb2-4b86-ac57-1807acf0858b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:16.630213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79eadc-cdb2-4b86-ac57-1807acf0858b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:16.630213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79eadc-cdb2-4b86-ac57-1807acf0858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:16.648902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4b79eadc-cdb2-4b86-ac57-1807acf0858b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:16.650191 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4b79eadc-cdb2-4b86-ac57-1807acf0858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:16.658470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:16.699198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857663e-c735-4977-8816-08823304e7c0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:16.710575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857663e-c735-4977-8816-08823304e7c0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:16.714122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6cfa0-fc9d-4f0b-a416-f5f2e373ac95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:16.714762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6cfa0-fc9d-4f0b-a416-f5f2e373ac95 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:16.715049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6cfa0-fc9d-4f0b-a416-f5f2e373ac95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:16.715327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6cfa0-fc9d-4f0b-a416-f5f2e373ac95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:16.724877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6cfa0-fc9d-4f0b-a416-f5f2e373ac95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:16.726332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6cfa0-fc9d-4f0b-a416-f5f2e373ac95 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:16.735770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 724/1449] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:19.027301 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2123-58de-4c3e-9008-014892a411c6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:19.027868 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2123-58de-4c3e-9008-014892a411c6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:19.027868 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2123-58de-4c3e-9008-014892a411c6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:19.029221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:19.035285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e80b4-c359-47bd-9402-276d4569ac21 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:19.035733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e80b4-c359-47bd-9402-276d4569ac21 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:19.035832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e80b4-c359-47bd-9402-276d4569ac21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:19.054148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e07e80b4-c359-47bd-9402-276d4569ac21 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:19.055361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e07e80b4-c359-47bd-9402-276d4569ac21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:19.064214 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:19.103565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2123-58de-4c3e-9008-014892a411c6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:19.115498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2123-58de-4c3e-9008-014892a411c6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:19.119021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38e159-768e-4a9d-9747-9b420439f2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:19.119657 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e159-768e-4a9d-9747-9b420439f2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:19.119944 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e159-768e-4a9d-9747-9b420439f2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:19.120224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e159-768e-4a9d-9747-9b420439f2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:19.130688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38e159-768e-4a9d-9747-9b420439f2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:19.132118 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38e159-768e-4a9d-9747-9b420439f2a3 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:19.143004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 727/1452] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:21.317190 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334f9df-e5e4-4234-89eb-f96f7ddb2188 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:21.317844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334f9df-e5e4-4234-89eb-f96f7ddb2188 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:21.318001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334f9df-e5e4-4234-89eb-f96f7ddb2188 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:21.319346 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:21.326137 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465911-1ea3-48cd-a027-fc825718778c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:21.326626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465911-1ea3-48cd-a027-fc825718778c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:21.327220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce465911-1ea3-48cd-a027-fc825718778c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:21.346291 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ce465911-1ea3-48cd-a027-fc825718778c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:21.347566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ce465911-1ea3-48cd-a027-fc825718778c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:21.359764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:21.400336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334f9df-e5e4-4234-89eb-f96f7ddb2188 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:21.412189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334f9df-e5e4-4234-89eb-f96f7ddb2188 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:21.415944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3265a5-71f7-40db-b822-637814d52686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:21.416591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3265a5-71f7-40db-b822-637814d52686 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:21.416879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3265a5-71f7-40db-b822-637814d52686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:21.417159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3265a5-71f7-40db-b822-637814d52686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:21.426984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3265a5-71f7-40db-b822-637814d52686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:21.428410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3265a5-71f7-40db-b822-637814d52686 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:21.438260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 727/1455] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:23.569226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aa1bf-8cf4-42ee-ab3b-59b5a2842369 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:23.569813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aa1bf-8cf4-42ee-ab3b-59b5a2842369 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:23.569947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aa1bf-8cf4-42ee-ab3b-59b5a2842369 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:23.571217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:23.576865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e131-eec3-44f6-bee4-4d5d9e6cf1ba None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:23.577369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e131-eec3-44f6-bee4-4d5d9e6cf1ba None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:23.577644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84e131-eec3-44f6-bee4-4d5d9e6cf1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:23.596457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7f84e131-eec3-44f6-bee4-4d5d9e6cf1ba None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:23.597675 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7f84e131-eec3-44f6-bee4-4d5d9e6cf1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:23.606058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:23.646510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517aa1bf-8cf4-42ee-ab3b-59b5a2842369 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:23.658040 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517aa1bf-8cf4-42ee-ab3b-59b5a2842369 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:23.662041 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecf9a8-3681-4aaa-b23d-308a0b7b16de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:23.662720 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecf9a8-3681-4aaa-b23d-308a0b7b16de service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:23.662999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecf9a8-3681-4aaa-b23d-308a0b7b16de service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:23.663282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecf9a8-3681-4aaa-b23d-308a0b7b16de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:23.673518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecf9a8-3681-4aaa-b23d-308a0b7b16de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:23.674957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecf9a8-3681-4aaa-b23d-308a0b7b16de service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:23.686836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 730/1458] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:25.942875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7a0e-210b-40e9-afc8-e34797bf8951 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:25.943750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7a0e-210b-40e9-afc8-e34797bf8951 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:25.943909 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7a0e-210b-40e9-afc8-e34797bf8951 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:25.945456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:25.952240 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502576d4-1ca6-4452-be3a-d7a632fc5163 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:25.958863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502576d4-1ca6-4452-be3a-d7a632fc5163 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:25.958863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502576d4-1ca6-4452-be3a-d7a632fc5163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:25.962701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=70 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:07:25.976667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-502576d4-1ca6-4452-be3a-d7a632fc5163 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:25.977906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-502576d4-1ca6-4452-be3a-d7a632fc5163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:25.989004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:07:26.025248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e7a0e-210b-40e9-afc8-e34797bf8951 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:26.031104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=73 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:07:26.038198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e7a0e-210b-40e9-afc8-e34797bf8951 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:26.041817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4775b1-7941-4bf5-864e-9fd3be33e987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:26.042496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4775b1-7941-4bf5-864e-9fd3be33e987 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:26.042781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4775b1-7941-4bf5-864e-9fd3be33e987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:26.043062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4775b1-7941-4bf5-864e-9fd3be33e987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:26.053216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4775b1-7941-4bf5-864e-9fd3be33e987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:26.054691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4775b1-7941-4bf5-864e-9fd3be33e987 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:26.065164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 730/1461] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:07:28.251292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d0423-c1bf-40af-ad66-829dade8ec5f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:28.251916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d0423-c1bf-40af-ad66-829dade8ec5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:28.251916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d0423-c1bf-40af-ad66-829dade8ec5f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:28.253322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:28.258744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb88dd-3f65-4fce-9f02-c0602affaa4b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:28.259186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb88dd-3f65-4fce-9f02-c0602affaa4b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:28.259295 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb88dd-3f65-4fce-9f02-c0602affaa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:28.277279 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7cdb88dd-3f65-4fce-9f02-c0602affaa4b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:28.278498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7cdb88dd-3f65-4fce-9f02-c0602affaa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:28.287296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:28.324330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d0423-c1bf-40af-ad66-829dade8ec5f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:28.335353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d0423-c1bf-40af-ad66-829dade8ec5f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:28.338803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7490920-8666-41ca-b492-400eeecc8568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:28.339446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7490920-8666-41ca-b492-400eeecc8568 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:28.339714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7490920-8666-41ca-b492-400eeecc8568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:28.339989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7490920-8666-41ca-b492-400eeecc8568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:28.350895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7490920-8666-41ca-b492-400eeecc8568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:28.352341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7490920-8666-41ca-b492-400eeecc8568 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:28.364170 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 733/1464] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:30.608503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684291c-377e-4927-95b6-a6e9f6b63782 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:30.609290 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684291c-377e-4927-95b6-a6e9f6b63782 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:30.609395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684291c-377e-4927-95b6-a6e9f6b63782 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:30.611049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:30.616916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80814f8-bd36-4a09-8309-aa9bd4edd3d9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:30.617394 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80814f8-bd36-4a09-8309-aa9bd4edd3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:30.617539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80814f8-bd36-4a09-8309-aa9bd4edd3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:30.636206 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f80814f8-bd36-4a09-8309-aa9bd4edd3d9 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:30.637422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f80814f8-bd36-4a09-8309-aa9bd4edd3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:30.646574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:30.685378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684291c-377e-4927-95b6-a6e9f6b63782 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:30.698483 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684291c-377e-4927-95b6-a6e9f6b63782 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:30.702672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590c174-f97c-4013-8025-1eafe67fdba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:30.703335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c174-f97c-4013-8025-1eafe67fdba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:30.703701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c174-f97c-4013-8025-1eafe67fdba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:30.704046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c174-f97c-4013-8025-1eafe67fdba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:30.713903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590c174-f97c-4013-8025-1eafe67fdba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:30.715334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590c174-f97c-4013-8025-1eafe67fdba9 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:30.726056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 733/1467] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:32.945936 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8c36-55d5-4eb1-9a6c-7d39ae42dbdb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:32.946489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8c36-55d5-4eb1-9a6c-7d39ae42dbdb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:32.946590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8c36-55d5-4eb1-9a6c-7d39ae42dbdb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:32.948561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:32.955997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4b3f3-1e41-4882-8067-e0b77c5e9032 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:32.956531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4b3f3-1e41-4882-8067-e0b77c5e9032 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:32.956531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4b3f3-1e41-4882-8067-e0b77c5e9032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:32.978710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-edc4b3f3-1e41-4882-8067-e0b77c5e9032 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:32.979971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-edc4b3f3-1e41-4882-8067-e0b77c5e9032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:32.995067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:33.043881 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee8c36-55d5-4eb1-9a6c-7d39ae42dbdb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:33.055948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee8c36-55d5-4eb1-9a6c-7d39ae42dbdb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:33.059969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce89e73-4062-4480-b81d-9367e6e821e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:33.060663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce89e73-4062-4480-b81d-9367e6e821e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:33.061037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce89e73-4062-4480-b81d-9367e6e821e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:33.061442 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce89e73-4062-4480-b81d-9367e6e821e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:33.075459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce89e73-4062-4480-b81d-9367e6e821e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:33.077755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce89e73-4062-4480-b81d-9367e6e821e2 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:33.093381 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 736/1470] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:42.969994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=17 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:07:43.085705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=17 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:07:53.674740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe94a3-09e4-41a4-ad87-7eb9b209ef04 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:53.675340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe94a3-09e4-41a4-ad87-7eb9b209ef04 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:53.675340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe94a3-09e4-41a4-ad87-7eb9b209ef04 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:53.676692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 735/1471] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:53.684431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe71a22-3867-42bd-a839-527a10f52e53 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:53.685025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe71a22-3867-42bd-a839-527a10f52e53 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:53.685025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe71a22-3867-42bd-a839-527a10f52e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:53.703186 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9fe71a22-3867-42bd-a839-527a10f52e53 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:53.704397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9fe71a22-3867-42bd-a839-527a10f52e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:53.712241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 737/1472] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:53.760311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdde48-cbbc-4a21-bad3-e1497b3941df None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:53.760603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdde48-cbbc-4a21-bad3-e1497b3941df None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:53.760884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdde48-cbbc-4a21-bad3-e1497b3941df None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:53.762282 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 736/1473] 10.222.0.90 () {54 vars in 962 bytes} [Tue Jun 21 15:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:53.767740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190adab9-c127-4129-8919-2dcd95260943 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:53.768038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190adab9-c127-4129-8919-2dcd95260943 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:53.768320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190adab9-c127-4129-8919-2dcd95260943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:53.786941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-190adab9-c127-4129-8919-2dcd95260943 None None] MFA Rules not processed for user `27ac2738bf434afabe3d227dc5e52650`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:53.788211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-190adab9-c127-4129-8919-2dcd95260943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:53.794734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 738/1474] 10.222.0.90 () {58 vars in 1059 bytes} [Tue Jun 21 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:53.801997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdde48-cbbc-4a21-bad3-e1497b3941df None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:53.812748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdde48-cbbc-4a21-bad3-e1497b3941df None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:53.816570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090bcff-2db2-4086-930f-19fd2cb5501d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ac2738bf434afabe3d227dc5e52650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:53.817209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090bcff-2db2-4086-930f-19fd2cb5501d service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:53.817512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090bcff-2db2-4086-930f-19fd2cb5501d service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:53.817791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090bcff-2db2-4086-930f-19fd2cb5501d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:53.827602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090bcff-2db2-4086-930f-19fd2cb5501d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:53.829022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090bcff-2db2-4086-930f-19fd2cb5501d service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:53.838901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 737/1475] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:07:55.989039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1300c8-e1b0-4c4f-978a-6f14f59867f2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:55.989656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1300c8-e1b0-4c4f-978a-6f14f59867f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:55.989656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1300c8-e1b0-4c4f-978a-6f14f59867f2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:55.991000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 739/1476] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:55.996536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25669f25-11f5-4575-8024-6651a59ca146 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:55.997005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25669f25-11f5-4575-8024-6651a59ca146 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:55.997122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25669f25-11f5-4575-8024-6651a59ca146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:56.015519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-25669f25-11f5-4575-8024-6651a59ca146 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:56.016727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-25669f25-11f5-4575-8024-6651a59ca146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:56.026390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 738/1477] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:56.052051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1300c8-e1b0-4c4f-978a-6f14f59867f2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:56.066179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1300c8-e1b0-4c4f-978a-6f14f59867f2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:56.070765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a9d02-ad88-44f5-9325-042f0cc31f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:56.071456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a9d02-ad88-44f5-9325-042f0cc31f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:56.071742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a9d02-ad88-44f5-9325-042f0cc31f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:56.072022 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a9d02-ad88-44f5-9325-042f0cc31f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:56.072767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a9d02-ad88-44f5-9325-042f0cc31f8b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:56.074827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-880a9d02-ad88-44f5-9325-042f0cc31f8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:07:56.074827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: warnings.warn(msg) Jun 21 15:07:56.074827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: Jun 21 15:07:56.076004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a9d02-ad88-44f5-9325-042f0cc31f8b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:56.097388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 740/1478] 10.222.0.90 () {56 vars in 1108 bytes} [Tue Jun 21 15:07:56 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:07:58.216116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f229-4b7d-4bc6-b668-02879fa1ac3c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:58.217330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f229-4b7d-4bc6-b668-02879fa1ac3c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:58.217330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4f229-4b7d-4bc6-b668-02879fa1ac3c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:58.218714 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 739/1479] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:07:58.223876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4729ad-92ee-48ea-b78d-eadf8b990ccc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:58.224312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4729ad-92ee-48ea-b78d-eadf8b990ccc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:58.224466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4729ad-92ee-48ea-b78d-eadf8b990ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:58.242507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0a4729ad-92ee-48ea-b78d-eadf8b990ccc None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:07:58.243708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0a4729ad-92ee-48ea-b78d-eadf8b990ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:07:58.251684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 741/1480] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:07:58.310417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f229-4b7d-4bc6-b668-02879fa1ac3c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:07:58.333541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4f229-4b7d-4bc6-b668-02879fa1ac3c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:07:58.339714 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1bf3a-7441-4b99-87a2-113cd95d3b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:07:58.340383 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1bf3a-7441-4b99-87a2-113cd95d3b1f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:07:58.340660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1bf3a-7441-4b99-87a2-113cd95d3b1f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:07:58.340933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1bf3a-7441-4b99-87a2-113cd95d3b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:07:58.350437 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1bf3a-7441-4b99-87a2-113cd95d3b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:07:58.352242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1bf3a-7441-4b99-87a2-113cd95d3b1f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:07:58.363295 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 740/1481] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:08:00.676449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7b4a5-fe4f-4b79-ba92-80b39ddccf0e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:00.677010 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7b4a5-fe4f-4b79-ba92-80b39ddccf0e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:00.677010 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7b4a5-fe4f-4b79-ba92-80b39ddccf0e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:00.678442 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 742/1482] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:08:00.686475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56fc33-6cd4-4c73-9519-f0a39bee3afd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:00.687256 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56fc33-6cd4-4c73-9519-f0a39bee3afd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:00.687361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56fc33-6cd4-4c73-9519-f0a39bee3afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:00.717002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2c56fc33-6cd4-4c73-9519-f0a39bee3afd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:08:00.718696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c56fc33-6cd4-4c73-9519-f0a39bee3afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:08:00.732070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 741/1483] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:08:00.787684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7b4a5-fe4f-4b79-ba92-80b39ddccf0e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:08:00.801055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7b4a5-fe4f-4b79-ba92-80b39ddccf0e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:08:00.804848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60235f52-01ed-4e90-95cb-fa2bd994b91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:08:00.805530 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235f52-01ed-4e90-95cb-fa2bd994b91e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:00.805820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235f52-01ed-4e90-95cb-fa2bd994b91e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:00.806101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235f52-01ed-4e90-95cb-fa2bd994b91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:00.816578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60235f52-01ed-4e90-95cb-fa2bd994b91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:08:00.818133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60235f52-01ed-4e90-95cb-fa2bd994b91e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:08:00.830180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 743/1484] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:08:02.959551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ffe90-1f38-4f3e-8629-098eb029304c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:02.960377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ffe90-1f38-4f3e-8629-098eb029304c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:02.960377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ffe90-1f38-4f3e-8629-098eb029304c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:02.961568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 742/1485] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:08:02.969606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cc0a9-6a1d-4ebc-86a7-7f3d8ae0c4e3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:02.970140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cc0a9-6a1d-4ebc-86a7-7f3d8ae0c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:02.970140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cc0a9-6a1d-4ebc-86a7-7f3d8ae0c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:02.988213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-435cc0a9-6a1d-4ebc-86a7-7f3d8ae0c4e3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:08:02.989428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-435cc0a9-6a1d-4ebc-86a7-7f3d8ae0c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:08:02.997715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 744/1486] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:08:03.040120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ffe90-1f38-4f3e-8629-098eb029304c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:08:03.056900 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ffe90-1f38-4f3e-8629-098eb029304c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:08:03.061049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1e38e-1573-4f5c-b2dc-fade3fa617fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:08:03.061805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1e38e-1573-4f5c-b2dc-fade3fa617fe service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:03.062085 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1e38e-1573-4f5c-b2dc-fade3fa617fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:03.062362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1e38e-1573-4f5c-b2dc-fade3fa617fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:03.073631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1e38e-1573-4f5c-b2dc-fade3fa617fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:08:03.075066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1e38e-1573-4f5c-b2dc-fade3fa617fe service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:08:03.088195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 743/1487] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:08:05.362497 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a9245-6993-4e14-bdbb-a2f27d48903d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:05.363074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a9245-6993-4e14-bdbb-a2f27d48903d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:05.363074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a9245-6993-4e14-bdbb-a2f27d48903d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:05.364436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 745/1488] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:08:05.369763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daaf32-08bd-4580-b8e7-ac7a9156ca71 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:05.370197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daaf32-08bd-4580-b8e7-ac7a9156ca71 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:05.370304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daaf32-08bd-4580-b8e7-ac7a9156ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:05.388013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-77daaf32-08bd-4580-b8e7-ac7a9156ca71 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:08:05.389285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-77daaf32-08bd-4580-b8e7-ac7a9156ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:08:05.397075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 744/1489] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:08:05.440226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a9245-6993-4e14-bdbb-a2f27d48903d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:08:05.452259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a9245-6993-4e14-bdbb-a2f27d48903d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:08:05.456042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aa6ce-66a4-4a51-8e4f-d111c3903325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:08:05.456740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa6ce-66a4-4a51-8e4f-d111c3903325 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:05.457062 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa6ce-66a4-4a51-8e4f-d111c3903325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:05.457367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa6ce-66a4-4a51-8e4f-d111c3903325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:05.467761 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa6ce-66a4-4a51-8e4f-d111c3903325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:08:05.469195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa6ce-66a4-4a51-8e4f-d111c3903325 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:08:05.478786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 746/1490] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:08:07.781450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e81cdf-b832-472b-aeeb-b2f767cace63 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:07.782015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e81cdf-b832-472b-aeeb-b2f767cace63 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:07.782015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e81cdf-b832-472b-aeeb-b2f767cace63 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:07.783425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 745/1491] 10.222.0.90 () {54 vars in 926 bytes} [Tue Jun 21 15:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:08:07.789406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f8aa0-475a-44aa-81a2-9f815c413656 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:07.789903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f8aa0-475a-44aa-81a2-9f815c413656 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:07.790042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f8aa0-475a-44aa-81a2-9f815c413656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:07.808251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fc3f8aa0-475a-44aa-81a2-9f815c413656 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:08:07.809640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fc3f8aa0-475a-44aa-81a2-9f815c413656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:08:07.817782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 747/1492] 10.222.0.90 () {58 vars in 1023 bytes} [Tue Jun 21 15:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:08:07.858225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e81cdf-b832-472b-aeeb-b2f767cace63 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:08:07.868979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e81cdf-b832-472b-aeeb-b2f767cace63 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:08:07.872918 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51eb57b-fa15-4b1f-9d2c-b4ae056ec21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:08:07.873810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51eb57b-fa15-4b1f-9d2c-b4ae056ec21b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:08:07.874099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51eb57b-fa15-4b1f-9d2c-b4ae056ec21b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:08:07.874382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51eb57b-fa15-4b1f-9d2c-b4ae056ec21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:08:07.883896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51eb57b-fa15-4b1f-9d2c-b4ae056ec21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:08:07.885342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51eb57b-fa15-4b1f-9d2c-b4ae056ec21b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:08:07.896212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 746/1493] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:08:17.803095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=33 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:08:17.891759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=33 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:09:35.351160 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad90e6-bd54-4854-a4d9-556e84a7445d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.351767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad90e6-bd54-4854-a4d9-556e84a7445d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.351767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad90e6-bd54-4854-a4d9-556e84a7445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.370238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dcad90e6-bd54-4854-a4d9-556e84a7445d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:09:35.372053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dcad90e6-bd54-4854-a4d9-556e84a7445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:09:35.380005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 748/1494] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:09:35.390134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883d28-5a53-4339-8545-53fbca03a1ec None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.390705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883d28-5a53-4339-8545-53fbca03a1ec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.390904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883d28-5a53-4339-8545-53fbca03a1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.409126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-78883d28-5a53-4339-8545-53fbca03a1ec None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:09:35.410629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-78883d28-5a53-4339-8545-53fbca03a1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:09:35.419174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 747/1495] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:09:35.424063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad90e6-bd54-4854-a4d9-556e84a7445d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:35.434834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad90e6-bd54-4854-a4d9-556e84a7445d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:35.439649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:35.440340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.440623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.440902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.441682 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:09:35.441993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:35.443025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:09:35.443025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: warnings.warn(msg) Jun 21 15:09:35.443025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: Jun 21 15:09:35.443936 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:35.457329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 749/1496] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:09:35.465946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883d28-5a53-4339-8545-53fbca03a1ec None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:35.475413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883d28-5a53-4339-8545-53fbca03a1ec None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:35.480084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bbc21-98a6-4424-ab5a-4fe71a883fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:35.480991 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bbc21-98a6-4424-ab5a-4fe71a883fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.481289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bbc21-98a6-4424-ab5a-4fe71a883fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.481604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bbc21-98a6-4424-ab5a-4fe71a883fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.482303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bbc21-98a6-4424-ab5a-4fe71a883fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:35.484132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-541bbc21-98a6-4424-ab5a-4fe71a883fb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:09:35.484132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: warnings.warn(msg) Jun 21 15:09:35.484132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: Jun 21 15:09:35.485328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bbc21-98a6-4424-ab5a-4fe71a883fb7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:35.527756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 748/1497] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:09:35 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:09:35.532039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:35.543408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d427e0-2fda-4c7f-81e0-2561e263230e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:35.600864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e7ad-f67c-49d6-b456-276e87a034a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:35.601654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e7ad-f67c-49d6-b456-276e87a034a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.601886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e7ad-f67c-49d6-b456-276e87a034a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.602163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3e7ad-f67c-49d6-b456-276e87a034a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.602869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e7ad-f67c-49d6-b456-276e87a034a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:35.603891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-41a3e7ad-f67c-49d6-b456-276e87a034a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:09:35.603891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: warnings.warn(msg) Jun 21 15:09:35.603891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: Jun 21 15:09:35.605626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3e7ad-f67c-49d6-b456-276e87a034a6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:35.628722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 750/1498] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:09:35 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:09:35.632686 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bbc21-98a6-4424-ab5a-4fe71a883fb7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:35.643372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bbc21-98a6-4424-ab5a-4fe71a883fb7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:35.648044 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23e71e-0783-44cd-889c-52c11ab90094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:35.648711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23e71e-0783-44cd-889c-52c11ab90094 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.648998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23e71e-0783-44cd-889c-52c11ab90094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.649302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23e71e-0783-44cd-889c-52c11ab90094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.650072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23e71e-0783-44cd-889c-52c11ab90094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:35.651093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-0e23e71e-0783-44cd-889c-52c11ab90094 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:09:35.651093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: warnings.warn(msg) Jun 21 15:09:35.651093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: Jun 21 15:09:35.652000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23e71e-0783-44cd-889c-52c11ab90094 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:35.665846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 749/1499] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:09:35.671262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e7ad-f67c-49d6-b456-276e87a034a6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:35.687593 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3e7ad-f67c-49d6-b456-276e87a034a6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:35.692326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b555977-d035-4a16-b1a3-30cce645247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:35.693117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b555977-d035-4a16-b1a3-30cce645247f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.693375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b555977-d035-4a16-b1a3-30cce645247f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.693678 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b555977-d035-4a16-b1a3-30cce645247f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.694416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b555977-d035-4a16-b1a3-30cce645247f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:35.695481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-1b555977-d035-4a16-b1a3-30cce645247f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:09:35.695481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: warnings.warn(msg) Jun 21 15:09:35.695481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: Jun 21 15:09:35.696339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b555977-d035-4a16-b1a3-30cce645247f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:35.712551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 751/1500] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:09:35.716971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23e71e-0783-44cd-889c-52c11ab90094 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:35.727187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23e71e-0783-44cd-889c-52c11ab90094 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:35.732674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5447cc-3401-49fd-9690-eaa8b72dee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:35.733605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5447cc-3401-49fd-9690-eaa8b72dee29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.733891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5447cc-3401-49fd-9690-eaa8b72dee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.734173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5447cc-3401-49fd-9690-eaa8b72dee29 admin admin] PATH_INFO: `/v3/projects/44228ed3ab154aca90a269d39b8af16b/users/3a365d9c38f246519abf15c9934badbf/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.750782 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5447cc-3401-49fd-9690-eaa8b72dee29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44228ed3ab154aca90a269d39b8af16b, user_id=3a365d9c38f246519abf15c9934badbf, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:35.751829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-ef5447cc-3401-49fd-9690-eaa8b72dee29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:09:35.751829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: warnings.warn(msg) Jun 21 15:09:35.751829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: Jun 21 15:09:35.753874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5447cc-3401-49fd-9690-eaa8b72dee29 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:35.767576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 750/1501] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:09:35 2022] PUT /identity/v3/projects/44228ed3ab154aca90a269d39b8af16b/users/3a365d9c38f246519abf15c9934badbf/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:09:35.779081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4198e-7426-450c-8052-aff473e539f5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.779365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4198e-7426-450c-8052-aff473e539f5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.779643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4198e-7426-450c-8052-aff473e539f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.807259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-70e4198e-7426-450c-8052-aff473e539f5 None None] MFA Rules not processed for user `3a365d9c38f246519abf15c9934badbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:09:35.809228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-70e4198e-7426-450c-8052-aff473e539f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:09:35.876455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 752/1502] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:09:35.890449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130052e3-bdf7-4749-a25e-53e09930150c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.890742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130052e3-bdf7-4749-a25e-53e09930150c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.891028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130052e3-bdf7-4749-a25e-53e09930150c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.892408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 751/1503] 10.222.0.90 () {54 vars in 963 bytes} [Tue Jun 21 15:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:09:35.897527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095bd79-c39c-4ebb-b31b-db5f2432391c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.897829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095bd79-c39c-4ebb-b31b-db5f2432391c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:35.898114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095bd79-c39c-4ebb-b31b-db5f2432391c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:35.917339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b095bd79-c39c-4ebb-b31b-db5f2432391c None None] MFA Rules not processed for user `b480c19eb6ec42979a81ad274acb1f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:09:35.918853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b095bd79-c39c-4ebb-b31b-db5f2432391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:09:35.965317 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:09:35.975833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 753/1504] 10.222.0.90 () {58 vars in 1060 bytes} [Tue Jun 21 15:09:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:09:35.983700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130052e3-bdf7-4749-a25e-53e09930150c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:35.994518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130052e3-bdf7-4749-a25e-53e09930150c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:35.998857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28188ac-fa85-409f-9487-4936496be3c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:35.999510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28188ac-fa85-409f-9487-4936496be3c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:35.999798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28188ac-fa85-409f-9487-4936496be3c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:36.000078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28188ac-fa85-409f-9487-4936496be3c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:36.008817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28188ac-fa85-409f-9487-4936496be3c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:36.010308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28188ac-fa85-409f-9487-4936496be3c3 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:36.021344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 752/1505] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:09:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:09:36.067352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79ffb-569c-4952-a44f-9b0d4bf3c86f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:36.067650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79ffb-569c-4952-a44f-9b0d4bf3c86f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:36.067932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d79ffb-569c-4952-a44f-9b0d4bf3c86f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:36.069208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 754/1506] 10.222.0.90 () {52 vars in 829 bytes} [Tue Jun 21 15:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:09:36.073041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28188ac-fa85-409f-9487-4936496be3c3 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:36.138719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28188ac-fa85-409f-9487-4936496be3c3 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:36.143433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:36.144316 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:36.144615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:36.144888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] PATH_INFO: `/v3/users/3a365d9c38f246519abf15c9934badbf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:36.146111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a365d9c38f246519abf15c9934badbf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:36.147136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:09:36.147136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: warnings.warn(msg) Jun 21 15:09:36.147136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: Jun 21 15:09:36.148351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:36.220351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a365d9c38f246519abf15c9934badbf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.241566 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a365d9c38f246519abf15c9934badbf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.254860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a365d9c38f246519abf15c9934badbf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.255711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a365d9c38f246519abf15c9934badbf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.256322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a365d9c38f246519abf15c9934badbf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.260366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:09:36.273536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 753/1507] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:09:36 2022] DELETE /identity/v3/users/3a365d9c38f246519abf15c9934badbf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:09:36.278155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c9f16-b4fc-4af6-b4a3-9485de6aebcf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:36.278444 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c9f16-b4fc-4af6-b4a3-9485de6aebcf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:36.278719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c9f16-b4fc-4af6-b4a3-9485de6aebcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:36.297357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8c2c9f16-b4fc-4af6-b4a3-9485de6aebcf None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:09:36.298212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8c2c9f16-b4fc-4af6-b4a3-9485de6aebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:09:36.360281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 755/1508] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:09:36.373078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:36.374571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:09:36.434981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2c6bc-a1f7-4dc3-9c4a-595651da5a53 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:36.438532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0481a44-c223-43da-bf3a-ccf36baf41db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:36.439180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481a44-c223-43da-bf3a-ccf36baf41db service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:36.439463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481a44-c223-43da-bf3a-ccf36baf41db service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:36.439740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0481a44-c223-43da-bf3a-ccf36baf41db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:36.449542 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0481a44-c223-43da-bf3a-ccf36baf41db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:36.451101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0481a44-c223-43da-bf3a-ccf36baf41db service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:36.462183 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 754/1509] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:09:36.821508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c9f16-b4fc-4af6-b4a3-9485de6aebcf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:09:36.823199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8c2c9f16-b4fc-4af6-b4a3-9485de6aebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:09:36.837549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c9f16-b4fc-4af6-b4a3-9485de6aebcf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:09:36.842587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:09:36.843572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:09:36.843730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:09:36.844023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] PATH_INFO: `/v3/projects/44228ed3ab154aca90a269d39b8af16b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:09:36.845391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44228ed3ab154aca90a269d39b8af16b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:09:36.846450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:09:36.846450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: warnings.warn(msg) Jun 21 15:09:36.846450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: Jun 21 15:09:36.847643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:09:36.926466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44228ed3ab154aca90a269d39b8af16b', 'request_id': 'req-e1ac0180-4344-48bf-9d02-9db0eabe1096'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.936502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44228ed3ab154aca90a269d39b8af16b', 'request_id': 'req-e1ac0180-4344-48bf-9d02-9db0eabe1096'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.943322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44228ed3ab154aca90a269d39b8af16b', 'request_id': 'req-e1ac0180-4344-48bf-9d02-9db0eabe1096'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.963022 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] The token cache is being invalidate because project 44228ed3ab154aca90a269d39b8af16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:09:36.963314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.964137 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1ac0180-4344-48bf-9d02-9db0eabe1096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:09:36.965947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 756/1510] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:09:36 2022] DELETE /identity/v3/projects/44228ed3ab154aca90a269d39b8af16b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:09:46.457507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:09:46.959834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:11:22.329086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0af8f-bcca-44d6-9a76-d5fcb8fa4221 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:22.329725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0af8f-bcca-44d6-9a76-d5fcb8fa4221 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:22.329725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0af8f-bcca-44d6-9a76-d5fcb8fa4221 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:22.331099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:11:22.335985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298b01-6f29-420e-8252-7538028f0bf0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:22.336429 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298b01-6f29-420e-8252-7538028f0bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:22.336595 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298b01-6f29-420e-8252-7538028f0bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:22.355034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2d298b01-6f29-420e-8252-7538028f0bf0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:22.356233 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2d298b01-6f29-420e-8252-7538028f0bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:22.414384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:11:22.570294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0af8f-bcca-44d6-9a76-d5fcb8fa4221 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:11:22.573017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1ee0af8f-bcca-44d6-9a76-d5fcb8fa4221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:22.648458 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0af8f-bcca-44d6-9a76-d5fcb8fa4221 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:11:22.654186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97760c63-53f6-4e4b-b37a-d6910adcda12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:11:22.654859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97760c63-53f6-4e4b-b37a-d6910adcda12 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:22.655179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97760c63-53f6-4e4b-b37a-d6910adcda12 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:22.655488 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97760c63-53f6-4e4b-b37a-d6910adcda12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:22.665017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97760c63-53f6-4e4b-b37a-d6910adcda12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:11:22.666643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97760c63-53f6-4e4b-b37a-d6910adcda12 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:11:22.676553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 756/1513] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:11:23.515502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04560c10-8bbc-4740-9abb-25d1edabc0ec None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:23.516071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04560c10-8bbc-4740-9abb-25d1edabc0ec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:23.516071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04560c10-8bbc-4740-9abb-25d1edabc0ec None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:23.517406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:11:23.522234 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4c234-31a5-49c3-85cf-ae137c3be9e2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:23.522638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4c234-31a5-49c3-85cf-ae137c3be9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:23.522823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4c234-31a5-49c3-85cf-ae137c3be9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:23.542444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cad4c234-31a5-49c3-85cf-ae137c3be9e2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:23.543652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cad4c234-31a5-49c3-85cf-ae137c3be9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:23.551514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:11:23.705287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04560c10-8bbc-4740-9abb-25d1edabc0ec None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:11:23.720158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04560c10-8bbc-4740-9abb-25d1edabc0ec None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:11:23.725453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe14f82-91a0-4ccb-9f26-50962c4d0577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:11:23.726098 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe14f82-91a0-4ccb-9f26-50962c4d0577 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:23.726378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe14f82-91a0-4ccb-9f26-50962c4d0577 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:23.726652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe14f82-91a0-4ccb-9f26-50962c4d0577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:23.734749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe14f82-91a0-4ccb-9f26-50962c4d0577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:11:23.736321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe14f82-91a0-4ccb-9f26-50962c4d0577 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:11:23.745654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 759/1516] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:11:23.999506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94997a2a-3e06-4ae4-884d-458b0a1235a2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:23.999825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94997a2a-3e06-4ae4-884d-458b0a1235a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:24.000112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94997a2a-3e06-4ae4-884d-458b0a1235a2 None None] PATH_INFO: `/v3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:24.001433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 758/1517] 10.222.0.55 () {54 vars in 925 bytes} [Tue Jun 21 15:11:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:11:24.012503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e03af7-16f2-438d-adf8-ab4fece9b178 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:24.012802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e03af7-16f2-438d-adf8-ab4fece9b178 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:24.013088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e03af7-16f2-438d-adf8-ab4fece9b178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:24.031428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-55e03af7-16f2-438d-adf8-ab4fece9b178 None None] MFA Rules not processed for user `5e916fba8123451587f5e13568630015`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:24.032577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-55e03af7-16f2-438d-adf8-ab4fece9b178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:24.094952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 760/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Jun 21 15:11:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:11:33.536310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=37 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:11:33.661364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17223c-9212-4e3a-9a31-e37e9975d3a8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:33.661833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17223c-9212-4e3a-9a31-e37e9975d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:33.662426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17223c-9212-4e3a-9a31-e37e9975d3a8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:33.663614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 759/1519] 10.222.0.90 () {54 vars in 960 bytes} [Tue Jun 21 15:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:11:33.670744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081d72-4d70-4795-b455-211e6f418184 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:33.671303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081d72-4d70-4795-b455-211e6f418184 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:33.671406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081d72-4d70-4795-b455-211e6f418184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:33.691692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c0081d72-4d70-4795-b455-211e6f418184 None None] MFA Rules not processed for user `5e916fba8123451587f5e13568630015`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:33.692908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c0081d72-4d70-4795-b455-211e6f418184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:33.703462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 761/1520] 10.222.0.90 () {58 vars in 1057 bytes} [Tue Jun 21 15:11:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:11:33.712572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17223c-9212-4e3a-9a31-e37e9975d3a8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:11:33.730360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17223c-9212-4e3a-9a31-e37e9975d3a8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:11:33.735768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279f837-2daa-408b-9ab2-c30a42166513 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:11:33.736821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f837-2daa-408b-9ab2-c30a42166513 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:33.737112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f837-2daa-408b-9ab2-c30a42166513 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:33.738241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f837-2daa-408b-9ab2-c30a42166513 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:33.748828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279f837-2daa-408b-9ab2-c30a42166513 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:11:33.750461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279f837-2daa-408b-9ab2-c30a42166513 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:11:33.760857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 760/1521] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:11:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:11:34.996975 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481cac7-c196-441d-a38b-3fcfcc2f274e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:34.997536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481cac7-c196-441d-a38b-3fcfcc2f274e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:34.997631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481cac7-c196-441d-a38b-3fcfcc2f274e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:34.998974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:11:35.003861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964515aa-d0d7-458e-aaeb-f5b910439abe None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:35.004429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964515aa-d0d7-458e-aaeb-f5b910439abe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:35.004429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964515aa-d0d7-458e-aaeb-f5b910439abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:35.023204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-964515aa-d0d7-458e-aaeb-f5b910439abe None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:35.025142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-964515aa-d0d7-458e-aaeb-f5b910439abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:35.034033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:11:35.203182 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481cac7-c196-441d-a38b-3fcfcc2f274e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:11:35.219322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481cac7-c196-441d-a38b-3fcfcc2f274e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:11:35.224817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddeae54-20b7-4ec6-94af-f563fbb0d914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:11:35.225487 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeae54-20b7-4ec6-94af-f563fbb0d914 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:35.225780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeae54-20b7-4ec6-94af-f563fbb0d914 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:35.226060 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddeae54-20b7-4ec6-94af-f563fbb0d914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:35.243071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeae54-20b7-4ec6-94af-f563fbb0d914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:11:35.244799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddeae54-20b7-4ec6-94af-f563fbb0d914 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:11:35.255395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 763/1524] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:11:36.109576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96639a2-316b-41c8-8b96-269f4313aba1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:36.110124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96639a2-316b-41c8-8b96-269f4313aba1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:36.110124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96639a2-316b-41c8-8b96-269f4313aba1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:36.111445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 15:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:11:36.116738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17f7c-a32d-49b1-bced-70dbd1c505c3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:36.117679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17f7c-a32d-49b1-bced-70dbd1c505c3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:36.117679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17f7c-a32d-49b1-bced-70dbd1c505c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:36.138908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9ef17f7c-a32d-49b1-bced-70dbd1c505c3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:36.140406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9ef17f7c-a32d-49b1-bced-70dbd1c505c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:36.150635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 15:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:11:36.311588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96639a2-316b-41c8-8b96-269f4313aba1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:11:36.327002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96639a2-316b-41c8-8b96-269f4313aba1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:11:36.332614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953b83f-bfcd-46ff-a909-7a366057fffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:11:36.333267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953b83f-bfcd-46ff-a909-7a366057fffe service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:36.333590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953b83f-bfcd-46ff-a909-7a366057fffe service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:36.333878 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953b83f-bfcd-46ff-a909-7a366057fffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:36.344003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953b83f-bfcd-46ff-a909-7a366057fffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:11:36.345628 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953b83f-bfcd-46ff-a909-7a366057fffe service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:11:36.356233 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 763/1527] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:11:41.169331 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b461c00-f32c-4591-a24a-173069e2f035 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:41.169931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b461c00-f32c-4591-a24a-173069e2f035 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:41.169931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b461c00-f32c-4591-a24a-173069e2f035 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:41.171287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:11:41.176767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c948a6-b33c-4193-a753-b77b6ed19f58 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:41.177263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c948a6-b33c-4193-a753-b77b6ed19f58 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:41.177432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c948a6-b33c-4193-a753-b77b6ed19f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:41.196873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-46c948a6-b33c-4193-a753-b77b6ed19f58 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:41.198009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-46c948a6-b33c-4193-a753-b77b6ed19f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:41.205884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:11:41.243491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b461c00-f32c-4591-a24a-173069e2f035 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:11:41.245214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b461c00-f32c-4591-a24a-173069e2f035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:41.304070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b461c00-f32c-4591-a24a-173069e2f035 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:11:41.307856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee9e25-4130-4d7f-924a-1b99d25a8d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:11:41.308522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9e25-4130-4d7f-924a-1b99d25a8d2b service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:41.308807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9e25-4130-4d7f-924a-1b99d25a8d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:41.309086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee9e25-4130-4d7f-924a-1b99d25a8d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:41.318614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee9e25-4130-4d7f-924a-1b99d25a8d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:11:41.320052 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee9e25-4130-4d7f-924a-1b99d25a8d2b service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:11:41.325776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:11:41.331505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 766/1530] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:11:43.380276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdec6c-561a-47e8-be61-846c1e5113f4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:43.380851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdec6c-561a-47e8-be61-846c1e5113f4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:43.380851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdec6c-561a-47e8-be61-846c1e5113f4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:43.382225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:11:43.388402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce2af3-ddbd-4fdf-947a-fe361ee5e517 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:43.388865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce2af3-ddbd-4fdf-947a-fe361ee5e517 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:43.389011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce2af3-ddbd-4fdf-947a-fe361ee5e517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:43.408196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7cce2af3-ddbd-4fdf-947a-fe361ee5e517 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:43.409691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7cce2af3-ddbd-4fdf-947a-fe361ee5e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:43.417423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:11:43.453694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdec6c-561a-47e8-be61-846c1e5113f4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:11:43.455364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45bdec6c-561a-47e8-be61-846c1e5113f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:43.469172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdec6c-561a-47e8-be61-846c1e5113f4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:11:43.472720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f79287-a203-46a5-9ea1-1d3191154714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:11:43.473345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f79287-a203-46a5-9ea1-1d3191154714 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:43.473738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f79287-a203-46a5-9ea1-1d3191154714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:43.474015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f79287-a203-46a5-9ea1-1d3191154714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:43.483062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f79287-a203-46a5-9ea1-1d3191154714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:11:43.484467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f79287-a203-46a5-9ea1-1d3191154714 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:11:43.494748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 766/1533] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:11:46.968374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd92b1c-abbf-42c4-bfee-99abfd7a69f4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:46.968908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd92b1c-abbf-42c4-bfee-99abfd7a69f4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:46.969048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd92b1c-abbf-42c4-bfee-99abfd7a69f4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:46.970561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:11:46.976531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884219a6-f600-4897-bdac-1cc8daa3fa02 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:46.976972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884219a6-f600-4897-bdac-1cc8daa3fa02 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:46.977135 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884219a6-f600-4897-bdac-1cc8daa3fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:46.995808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-884219a6-f600-4897-bdac-1cc8daa3fa02 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:46.997000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-884219a6-f600-4897-bdac-1cc8daa3fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:47.004941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:11:47.318858 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd92b1c-abbf-42c4-bfee-99abfd7a69f4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:11:47.321304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ddd92b1c-abbf-42c4-bfee-99abfd7a69f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:47.382723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd92b1c-abbf-42c4-bfee-99abfd7a69f4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:11:47.387066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62694973-e957-4029-bdb5-cf77a12c2b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:11:47.387710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62694973-e957-4029-bdb5-cf77a12c2b86 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:47.388002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62694973-e957-4029-bdb5-cf77a12c2b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:47.388278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62694973-e957-4029-bdb5-cf77a12c2b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:47.397361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62694973-e957-4029-bdb5-cf77a12c2b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:11:47.398918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62694973-e957-4029-bdb5-cf77a12c2b86 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:11:47.409260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 769/1536] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:11:49.543556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6c1b0-549d-43d3-ab4f-0608cd803e59 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:49.544176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6c1b0-549d-43d3-ab4f-0608cd803e59 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:49.544176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6c1b0-549d-43d3-ab4f-0608cd803e59 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:49.545525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 15:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:11:49.550817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49d90a-388d-4e5e-9c6b-c8e4ffffe4cc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:49.551249 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49d90a-388d-4e5e-9c6b-c8e4ffffe4cc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:49.551431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49d90a-388d-4e5e-9c6b-c8e4ffffe4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:49.572218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bb49d90a-388d-4e5e-9c6b-c8e4ffffe4cc None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:11:49.573451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bb49d90a-388d-4e5e-9c6b-c8e4ffffe4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:49.581659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 15:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:11:49.906699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6c1b0-549d-43d3-ab4f-0608cd803e59 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:11:49.908430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ebd6c1b0-549d-43d3-ab4f-0608cd803e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:11:49.922669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6c1b0-549d-43d3-ab4f-0608cd803e59 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:11:49.926189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa3798-bff7-4c03-ba9a-f5bdd0c6f5ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:11:49.926826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa3798-bff7-4c03-ba9a-f5bdd0c6f5ed service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:11:49.927111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa3798-bff7-4c03-ba9a-f5bdd0c6f5ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:11:49.927390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa3798-bff7-4c03-ba9a-f5bdd0c6f5ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:11:49.937699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa3798-bff7-4c03-ba9a-f5bdd0c6f5ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:11:49.939158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa3798-bff7-4c03-ba9a-f5bdd0c6f5ed service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:11:49.949901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 769/1539] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:11:59.565414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=32 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:11:59.944334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=33 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:21.933989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae531618-f966-4a8f-b99e-045185daaca1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:21.935841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae531618-f966-4a8f-b99e-045185daaca1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:21.935841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae531618-f966-4a8f-b99e-045185daaca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:21.962057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ae531618-f966-4a8f-b99e-045185daaca1 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:21.963961 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae531618-f966-4a8f-b99e-045185daaca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:21.977372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 771/1540] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:21.988027 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3af417-918b-4830-a94a-108395a6d442 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:21.989076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3af417-918b-4830-a94a-108395a6d442 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:21.989617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3af417-918b-4830-a94a-108395a6d442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.012629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2d3af417-918b-4830-a94a-108395a6d442 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.014264 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d3af417-918b-4830-a94a-108395a6d442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.028760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 770/1541] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.033965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae531618-f966-4a8f-b99e-045185daaca1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.051217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae531618-f966-4a8f-b99e-045185daaca1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.056450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5e14d-41db-4c89-a76a-667eb165e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.057422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e14d-41db-4c89-a76a-667eb165e7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.057971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e14d-41db-4c89-a76a-667eb165e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.058476 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e14d-41db-4c89-a76a-667eb165e7a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.059432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5e14d-41db-4c89-a76a-667eb165e7a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:22.060200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5e14d-41db-4c89-a76a-667eb165e7a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.062074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5e14d-41db-4c89-a76a-667eb165e7a8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.079589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0ba6b-3031-465e-a7f3-8844b3e5ee39 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.080273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0ba6b-3031-465e-a7f3-8844b3e5ee39 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.080987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0ba6b-3031-465e-a7f3-8844b3e5ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.081879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 772/1542] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:22.090398 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5e14d-41db-4c89-a76a-667eb165e7a8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.103500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5e14d-41db-4c89-a76a-667eb165e7a8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.108250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-42f0ba6b-3031-465e-a7f3-8844b3e5ee39 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.109746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42f0ba6b-3031-465e-a7f3-8844b3e5ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.111855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2db3f2-fb8c-46f3-a74a-d01d38438494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.112536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2db3f2-fb8c-46f3-a74a-d01d38438494 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.112820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2db3f2-fb8c-46f3-a74a-d01d38438494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.113100 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2db3f2-fb8c-46f3-a74a-d01d38438494 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.114004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2db3f2-fb8c-46f3-a74a-d01d38438494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.115340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-ea2db3f2-fb8c-46f3-a74a-d01d38438494 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:13:22.115340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: warnings.warn(msg) Jun 21 15:13:22.115340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: Jun 21 15:13:22.117051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2db3f2-fb8c-46f3-a74a-d01d38438494 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.124143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 771/1543] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.125918 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1c7a-a4ba-4ec5-ae12-b470267f764d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.126456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1c7a-a4ba-4ec5-ae12-b470267f764d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.126969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1c7a-a4ba-4ec5-ae12-b470267f764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.158911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-781a1c7a-a4ba-4ec5-ae12-b470267f764d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.159687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 773/1544] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:13:22.160745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-781a1c7a-a4ba-4ec5-ae12-b470267f764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.161205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e68c5-992c-40a9-b281-f556e5bbe781 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.161515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e68c5-992c-40a9-b281-f556e5bbe781 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.162481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e68c5-992c-40a9-b281-f556e5bbe781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.195133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8f1e68c5-992c-40a9-b281-f556e5bbe781 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.196938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8f1e68c5-992c-40a9-b281-f556e5bbe781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.247647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 772/1545] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.248479 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a1c7a-a4ba-4ec5-ae12-b470267f764d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.259966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a1c7a-a4ba-4ec5-ae12-b470267f764d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.264872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7443e6b-fc62-4e41-8120-d3faf4a6a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.265576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7443e6b-fc62-4e41-8120-d3faf4a6a657 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.265872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7443e6b-fc62-4e41-8120-d3faf4a6a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.266150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7443e6b-fc62-4e41-8120-d3faf4a6a657 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.266836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7443e6b-fc62-4e41-8120-d3faf4a6a657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.267855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-c7443e6b-fc62-4e41-8120-d3faf4a6a657 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:13:22.267855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: warnings.warn(msg) Jun 21 15:13:22.267855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: Jun 21 15:13:22.269061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7443e6b-fc62-4e41-8120-d3faf4a6a657 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.269984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 774/1546] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.277812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53f2f-7425-4a9d-b737-729929368afd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.277812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53f2f-7425-4a9d-b737-729929368afd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.277812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53f2f-7425-4a9d-b737-729929368afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.291440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 773/1547] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:22.292715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53cb17-934f-4f72-a7b7-c66a30dbc71f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.293035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53cb17-934f-4f72-a7b7-c66a30dbc71f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.293317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53cb17-934f-4f72-a7b7-c66a30dbc71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.298871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b5d53f2f-7425-4a9d-b737-729929368afd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.300100 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b5d53f2f-7425-4a9d-b737-729929368afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.308564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 775/1548] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.309815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a6948-a478-43b2-b7eb-ed6ac8f5e8b0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.310108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a6948-a478-43b2-b7eb-ed6ac8f5e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.310376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a6948-a478-43b2-b7eb-ed6ac8f5e8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.311477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8f53cb17-934f-4f72-a7b7-c66a30dbc71f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.312672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f53cb17-934f-4f72-a7b7-c66a30dbc71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.328272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 774/1549] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.328272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61ca25-6bb9-4ad9-a33e-a3ccbf18b30c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.328272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61ca25-6bb9-4ad9-a33e-a3ccbf18b30c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.328272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61ca25-6bb9-4ad9-a33e-a3ccbf18b30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.334757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-268a6948-a478-43b2-b7eb-ed6ac8f5e8b0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.336052 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-268a6948-a478-43b2-b7eb-ed6ac8f5e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.342503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7d61ca25-6bb9-4ad9-a33e-a3ccbf18b30c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.343723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7d61ca25-6bb9-4ad9-a33e-a3ccbf18b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.344176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 776/1550] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.345384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b91c3-931d-4136-ac22-e424aeca429f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.345738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b91c3-931d-4136-ac22-e424aeca429f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.345968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b91c3-931d-4136-ac22-e424aeca429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.351931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 775/1551] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.353000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6749f-0434-4c65-b353-8223b493d4a9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.353304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6749f-0434-4c65-b353-8223b493d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.353770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6749f-0434-4c65-b353-8223b493d4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.370754 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ff9b91c3-931d-4136-ac22-e424aeca429f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.371552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f3f6749f-0434-4c65-b353-8223b493d4a9 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.371955 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ff9b91c3-931d-4136-ac22-e424aeca429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.372791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3f6749f-0434-4c65-b353-8223b493d4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.379815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 777/1552] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.384920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b91c3-931d-4136-ac22-e424aeca429f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.385098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 776/1553] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.385098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6749f-0434-4c65-b353-8223b493d4a9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.395052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6749f-0434-4c65-b353-8223b493d4a9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.395549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b91c3-931d-4136-ac22-e424aeca429f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.400291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285db15-fba6-48e3-8893-674cade80834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.400989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285db15-fba6-48e3-8893-674cade80834 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.401101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5095cd1-842b-4ab2-bdab-62cb332b870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.401291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285db15-fba6-48e3-8893-674cade80834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.401613 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285db15-fba6-48e3-8893-674cade80834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.401762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5095cd1-842b-4ab2-bdab-62cb332b870f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.402054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5095cd1-842b-4ab2-bdab-62cb332b870f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.402336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5095cd1-842b-4ab2-bdab-62cb332b870f admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.402451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285db15-fba6-48e3-8893-674cade80834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.403067 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5095cd1-842b-4ab2-bdab-62cb332b870f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:22.403380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5095cd1-842b-4ab2-bdab-62cb332b870f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.404060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285db15-fba6-48e3-8893-674cade80834 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.405013 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5095cd1-842b-4ab2-bdab-62cb332b870f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.414674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 777/1554] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:22.415998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb16fba-604b-4a47-a6be-4d2140c6f56b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.416292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb16fba-604b-4a47-a6be-4d2140c6f56b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.416570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb16fba-604b-4a47-a6be-4d2140c6f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.417328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 778/1555] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:22.418727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8992ec2-0523-4d20-82d7-cfab5c60a913 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.419019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8992ec2-0523-4d20-82d7-cfab5c60a913 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.419300 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8992ec2-0523-4d20-82d7-cfab5c60a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.438005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c8992ec2-0523-4d20-82d7-cfab5c60a913 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.439269 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c8992ec2-0523-4d20-82d7-cfab5c60a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.441518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fbb16fba-604b-4a47-a6be-4d2140c6f56b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.442726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fbb16fba-604b-4a47-a6be-4d2140c6f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.448126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 779/1556] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.449337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b1253-2943-4096-8f05-e8064c6e3f23 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.449661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b1253-2943-4096-8f05-e8064c6e3f23 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.449949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b1253-2943-4096-8f05-e8064c6e3f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.451587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 778/1557] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.451587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db231295-1c08-4069-b61a-4f560d3f386b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.451587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db231295-1c08-4069-b61a-4f560d3f386b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.451587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db231295-1c08-4069-b61a-4f560d3f386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.472500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e87b1253-2943-4096-8f05-e8064c6e3f23 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.473003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-db231295-1c08-4069-b61a-4f560d3f386b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.473732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e87b1253-2943-4096-8f05-e8064c6e3f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.474217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-db231295-1c08-4069-b61a-4f560d3f386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.486175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 780/1558] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.486366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 779/1559] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.486563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b1253-2943-4096-8f05-e8064c6e3f23 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.486649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb070409-72db-4d42-a352-10ce7efd2a2b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.486649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb070409-72db-4d42-a352-10ce7efd2a2b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.486649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb070409-72db-4d42-a352-10ce7efd2a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.496180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b1253-2943-4096-8f05-e8064c6e3f23 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.500848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db043f6-5875-45b4-b9df-38446a269795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.501518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db043f6-5875-45b4-b9df-38446a269795 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.501810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db043f6-5875-45b4-b9df-38446a269795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.502093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db043f6-5875-45b4-b9df-38446a269795 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.502813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db043f6-5875-45b4-b9df-38446a269795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:22.502923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bb070409-72db-4d42-a352-10ce7efd2a2b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:22.503123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db043f6-5875-45b4-b9df-38446a269795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.504009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb070409-72db-4d42-a352-10ce7efd2a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:22.504716 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db043f6-5875-45b4-b9df-38446a269795 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.511980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 780/1560] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:22.512761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb070409-72db-4d42-a352-10ce7efd2a2b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.526049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 781/1561] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:22.526049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db043f6-5875-45b4-b9df-38446a269795 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.526349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb070409-72db-4d42-a352-10ce7efd2a2b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.527417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcfd60-5403-4b7d-8a18-5c58758e237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.528069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcfd60-5403-4b7d-8a18-5c58758e237e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.528355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcfd60-5403-4b7d-8a18-5c58758e237e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.528635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcfd60-5403-4b7d-8a18-5c58758e237e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.529359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcfd60-5403-4b7d-8a18-5c58758e237e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.529911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db043f6-5875-45b4-b9df-38446a269795 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.530986 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcfd60-5403-4b7d-8a18-5c58758e237e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.534809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0825a06-1067-4dd3-9fba-58357299b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.535447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0825a06-1067-4dd3-9fba-58357299b5da admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.535737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0825a06-1067-4dd3-9fba-58357299b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.536025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0825a06-1067-4dd3-9fba-58357299b5da admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.537373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0825a06-1067-4dd3-9fba-58357299b5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.539479 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0825a06-1067-4dd3-9fba-58357299b5da admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.542182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 781/1562] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:22.542990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcfd60-5403-4b7d-8a18-5c58758e237e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.553282 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcfd60-5403-4b7d-8a18-5c58758e237e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.559092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.559965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.560481 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.560763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.561524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:22.561887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.562982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:13:22.562982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: warnings.warn(msg) Jun 21 15:13:22.562982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: Jun 21 15:13:22.563872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.568019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 782/1563] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:22.569171 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0825a06-1067-4dd3-9fba-58357299b5da admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.577235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 782/1564] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:22.578093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.589353 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c078d-a842-4c14-90a8-13d6e955a363 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.619281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:22.641195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:22.642589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0825a06-1067-4dd3-9fba-58357299b5da admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.648474 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed89b-9356-4b5d-a978-26889f02659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.649195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed89b-9356-4b5d-a978-26889f02659d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.649499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed89b-9356-4b5d-a978-26889f02659d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.649879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed89b-9356-4b5d-a978-26889f02659d admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.650520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed89b-9356-4b5d-a978-26889f02659d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:22.650833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed89b-9356-4b5d-a978-26889f02659d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.651343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7acb35-7be0-4a82-844b-72971154dea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.652015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7acb35-7be0-4a82-844b-72971154dea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.652300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7acb35-7be0-4a82-844b-72971154dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.652472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed89b-9356-4b5d-a978-26889f02659d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.652578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7acb35-7be0-4a82-844b-72971154dea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.653284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7acb35-7be0-4a82-844b-72971154dea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:22.653624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7acb35-7be0-4a82-844b-72971154dea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.655215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7acb35-7be0-4a82-844b-72971154dea4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.666941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 783/1565] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:22.667794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 783/1566] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:22.668086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed89b-9356-4b5d-a978-26889f02659d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.668594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7acb35-7be0-4a82-844b-72971154dea4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.679048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7acb35-7be0-4a82-844b-72971154dea4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.683666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08fcd5-f534-4f51-a416-2a8d94f5652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.684344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08fcd5-f534-4f51-a416-2a8d94f5652b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.684629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08fcd5-f534-4f51-a416-2a8d94f5652b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.684807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed89b-9356-4b5d-a978-26889f02659d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.684939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08fcd5-f534-4f51-a416-2a8d94f5652b admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.685654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08fcd5-f534-4f51-a416-2a8d94f5652b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:22.686117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08fcd5-f534-4f51-a416-2a8d94f5652b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.687722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08fcd5-f534-4f51-a416-2a8d94f5652b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.689348 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1f05f-6f69-47bb-a317-87cbabae3bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.690403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1f05f-6f69-47bb-a317-87cbabae3bab admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.690403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1f05f-6f69-47bb-a317-87cbabae3bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.690622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1f05f-6f69-47bb-a317-87cbabae3bab admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.691258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1f05f-6f69-47bb-a317-87cbabae3bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:22.691563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1f05f-6f69-47bb-a317-87cbabae3bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.693403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1f05f-6f69-47bb-a317-87cbabae3bab admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.700170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 784/1567] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:22.700958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08fcd5-f534-4f51-a416-2a8d94f5652b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.711198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08fcd5-f534-4f51-a416-2a8d94f5652b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.712691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 784/1568] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:22.713282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1f05f-6f69-47bb-a317-87cbabae3bab admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.723901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46545a9-baa5-4998-9233-650fb9bde435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.725300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46545a9-baa5-4998-9233-650fb9bde435 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.725624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46545a9-baa5-4998-9233-650fb9bde435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.725911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46545a9-baa5-4998-9233-650fb9bde435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.726776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46545a9-baa5-4998-9233-650fb9bde435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.728961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46545a9-baa5-4998-9233-650fb9bde435 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.732458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1f05f-6f69-47bb-a317-87cbabae3bab admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.740015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abf2da-9409-4466-8e21-7c5f6f5709c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.740731 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abf2da-9409-4466-8e21-7c5f6f5709c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.741025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abf2da-9409-4466-8e21-7c5f6f5709c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.741460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abf2da-9409-4466-8e21-7c5f6f5709c3 admin admin] PATH_INFO: `/v3/projects/49ed2d170ec6473a889d9c344f403355/users/f72295caacba4e8b818e13b445be3a24/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.758077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 785/1569] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:22.759026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46545a9-baa5-4998-9233-650fb9bde435 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.760584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abf2da-9409-4466-8e21-7c5f6f5709c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ed2d170ec6473a889d9c344f403355, user_id=f72295caacba4e8b818e13b445be3a24, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.761844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-28abf2da-9409-4466-8e21-7c5f6f5709c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:13:22.761844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: warnings.warn(msg) Jun 21 15:13:22.761844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: Jun 21 15:13:22.763765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abf2da-9409-4466-8e21-7c5f6f5709c3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.778939 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 785/1570] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:22 2022] PUT /identity/v3/projects/49ed2d170ec6473a889d9c344f403355/users/f72295caacba4e8b818e13b445be3a24/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:22.780140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abf2da-9409-4466-8e21-7c5f6f5709c3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.824026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46545a9-baa5-4998-9233-650fb9bde435 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.847058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abf2da-9409-4466-8e21-7c5f6f5709c3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.852855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303a13b-8b1b-4ff6-98a3-c25094e3bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.853551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303a13b-8b1b-4ff6-98a3-c25094e3bf7e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.853842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303a13b-8b1b-4ff6-98a3-c25094e3bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.854123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303a13b-8b1b-4ff6-98a3-c25094e3bf7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.854812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303a13b-8b1b-4ff6-98a3-c25094e3bf7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.856713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303a13b-8b1b-4ff6-98a3-c25094e3bf7e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.882649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 786/1571] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:22.883518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303a13b-8b1b-4ff6-98a3-c25094e3bf7e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.887845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5c9d3-6703-4b83-9a24-939dfb38a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.888529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5c9d3-6703-4b83-9a24-939dfb38a480 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.888822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5c9d3-6703-4b83-9a24-939dfb38a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.889232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5c9d3-6703-4b83-9a24-939dfb38a480 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.889974 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5c9d3-6703-4b83-9a24-939dfb38a480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.891972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5c9d3-6703-4b83-9a24-939dfb38a480 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.918609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 786/1572] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:22.918609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5c9d3-6703-4b83-9a24-939dfb38a480 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.932617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5c9d3-6703-4b83-9a24-939dfb38a480 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.954093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303a13b-8b1b-4ff6-98a3-c25094e3bf7e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:22.959744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3637c-d7aa-4926-9172-93c533ff4906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.960153 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3637c-d7aa-4926-9172-93c533ff4906 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:22.960439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3637c-d7aa-4926-9172-93c533ff4906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:22.960721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3637c-d7aa-4926-9172-93c533ff4906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:22.961408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3637c-d7aa-4926-9172-93c533ff4906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:22.963349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3637c-d7aa-4926-9172-93c533ff4906 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:22.982257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:22.990203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 787/1573] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:22.991158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3637c-d7aa-4926-9172-93c533ff4906 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:22.996944 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:22.999146 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7de0d3-086c-46ba-95ec-b40ff61d9997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:22.999907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7de0d3-086c-46ba-95ec-b40ff61d9997 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.000105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7de0d3-086c-46ba-95ec-b40ff61d9997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.000389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7de0d3-086c-46ba-95ec-b40ff61d9997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.001092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7de0d3-086c-46ba-95ec-b40ff61d9997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.003086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7de0d3-086c-46ba-95ec-b40ff61d9997 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.031027 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 787/1574] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:23.032258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7de0d3-086c-46ba-95ec-b40ff61d9997 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.066721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3637c-d7aa-4926-9172-93c533ff4906 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.098042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7de0d3-086c-46ba-95ec-b40ff61d9997 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.102906 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2beadf-3096-4c92-b7f7-2d949aafd2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.103571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2beadf-3096-4c92-b7f7-2d949aafd2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.103854 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2beadf-3096-4c92-b7f7-2d949aafd2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.104133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2beadf-3096-4c92-b7f7-2d949aafd2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.104844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2beadf-3096-4c92-b7f7-2d949aafd2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.106907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2beadf-3096-4c92-b7f7-2d949aafd2c9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.125664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bb28f-0329-4dc6-8026-a893a15d794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.126303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb28f-0329-4dc6-8026-a893a15d794c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.126595 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb28f-0329-4dc6-8026-a893a15d794c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.126873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb28f-0329-4dc6-8026-a893a15d794c admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.127566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bb28f-0329-4dc6-8026-a893a15d794c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.131569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bb28f-0329-4dc6-8026-a893a15d794c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.147925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 788/1575] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:23.148916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2beadf-3096-4c92-b7f7-2d949aafd2c9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.168154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 788/1576] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:22 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:23.168154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8402b-338a-4e97-9af4-093dac751ef6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.168154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8402b-338a-4e97-9af4-093dac751ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.168154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8402b-338a-4e97-9af4-093dac751ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.197346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-21d8402b-338a-4e97-9af4-093dac751ef6 None None] MFA Rules not processed for user `f72295caacba4e8b818e13b445be3a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:23.198604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-21d8402b-338a-4e97-9af4-093dac751ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:23.223821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2beadf-3096-4c92-b7f7-2d949aafd2c9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.267016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 789/1577] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:23.268199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8402b-338a-4e97-9af4-093dac751ef6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.281683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee100d7-341f-41f4-a8de-7ecea2d69fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.282362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee100d7-341f-41f4-a8de-7ecea2d69fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.282646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee100d7-341f-41f4-a8de-7ecea2d69fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.283183 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee100d7-341f-41f4-a8de-7ecea2d69fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.283905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee100d7-341f-41f4-a8de-7ecea2d69fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.285951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee100d7-341f-41f4-a8de-7ecea2d69fd0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.304764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:23.309600 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:23.315303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 789/1578] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:23.316858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee100d7-341f-41f4-a8de-7ecea2d69fd0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.329868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee100d7-341f-41f4-a8de-7ecea2d69fd0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.334573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0fb4e-399d-40a8-91a3-670a336e9cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.335231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0fb4e-399d-40a8-91a3-670a336e9cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.335511 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0fb4e-399d-40a8-91a3-670a336e9cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.335865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0fb4e-399d-40a8-91a3-670a336e9cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.336571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0fb4e-399d-40a8-91a3-670a336e9cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.338187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0fb4e-399d-40a8-91a3-670a336e9cb4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.348353 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 790/1579] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.349404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0fb4e-399d-40a8-91a3-670a336e9cb4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.352575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8402b-338a-4e97-9af4-093dac751ef6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.357115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a727b9b-1e2b-47ff-b822-128a94b29d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.357815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a727b9b-1e2b-47ff-b822-128a94b29d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.358101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a727b9b-1e2b-47ff-b822-128a94b29d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.358374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a727b9b-1e2b-47ff-b822-128a94b29d60 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.359061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a727b9b-1e2b-47ff-b822-128a94b29d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.359166 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0fb4e-399d-40a8-91a3-670a336e9cb4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.360992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a727b9b-1e2b-47ff-b822-128a94b29d60 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.363754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6cafe-138a-447e-ba7b-f9e6ccadd05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.364397 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6cafe-138a-447e-ba7b-f9e6ccadd05b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.364685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6cafe-138a-447e-ba7b-f9e6ccadd05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.365503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6cafe-138a-447e-ba7b-f9e6ccadd05b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.366194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6cafe-138a-447e-ba7b-f9e6ccadd05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.368093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6cafe-138a-447e-ba7b-f9e6ccadd05b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.383984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 790/1580] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:23.387380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a727b9b-1e2b-47ff-b822-128a94b29d60 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.392209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 791/1581] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:23.392209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6cafe-138a-447e-ba7b-f9e6ccadd05b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.394938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a727b9b-1e2b-47ff-b822-128a94b29d60 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.399731 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcca81-e84e-4255-9bc7-49ae982d8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.400385 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcca81-e84e-4255-9bc7-49ae982d8692 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.400668 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcca81-e84e-4255-9bc7-49ae982d8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.400945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcca81-e84e-4255-9bc7-49ae982d8692 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.401649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcca81-e84e-4255-9bc7-49ae982d8692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.402731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6cafe-138a-447e-ba7b-f9e6ccadd05b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.403550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcca81-e84e-4255-9bc7-49ae982d8692 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.407333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f531e-8d1c-4bed-aefa-ca05a2318df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.408233 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f531e-8d1c-4bed-aefa-ca05a2318df2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.408517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f531e-8d1c-4bed-aefa-ca05a2318df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.408793 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f531e-8d1c-4bed-aefa-ca05a2318df2 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.409621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f531e-8d1c-4bed-aefa-ca05a2318df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.411510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f531e-8d1c-4bed-aefa-ca05a2318df2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.429793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 791/1582] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:23.429793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcca81-e84e-4255-9bc7-49ae982d8692 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.438862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 792/1583] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:23.438862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b529e-5b6b-45c8-95e7-df39243e0ee7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.439116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcca81-e84e-4255-9bc7-49ae982d8692 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.439202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b529e-5b6b-45c8-95e7-df39243e0ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.439202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b529e-5b6b-45c8-95e7-df39243e0ee7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.439516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 793/1584] 10.222.0.90 () {54 vars in 961 bytes} [Tue Jun 21 15:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:13:23.440143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b529e-5b6b-45c8-95e7-df39243e0ee7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.445228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4a9a7-8f7d-424f-ad16-2a756bd04c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.445921 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4a9a7-8f7d-424f-ad16-2a756bd04c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.446206 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4a9a7-8f7d-424f-ad16-2a756bd04c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.446489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4a9a7-8f7d-424f-ad16-2a756bd04c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.447180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4a9a7-8f7d-424f-ad16-2a756bd04c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.449296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4a9a7-8f7d-424f-ad16-2a756bd04c6a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.453344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b529e-5b6b-45c8-95e7-df39243e0ee7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.458002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba186a-bda3-4084-998d-dfbcf5c6f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.458690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba186a-bda3-4084-998d-dfbcf5c6f892 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.458978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba186a-bda3-4084-998d-dfbcf5c6f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.459341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba186a-bda3-4084-998d-dfbcf5c6f892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.460173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba186a-bda3-4084-998d-dfbcf5c6f892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.461856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba186a-bda3-4084-998d-dfbcf5c6f892 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.470015 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 792/1585] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:23.470641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4a9a7-8f7d-424f-ad16-2a756bd04c6a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.475215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 794/1586] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.476094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba186a-bda3-4084-998d-dfbcf5c6f892 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.480797 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4a9a7-8f7d-424f-ad16-2a756bd04c6a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.485414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb770-4603-446e-8e03-6440d237c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.486094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb770-4603-446e-8e03-6440d237c77b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.486384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb770-4603-446e-8e03-6440d237c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.486663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb770-4603-446e-8e03-6440d237c77b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.487388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb770-4603-446e-8e03-6440d237c77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.488633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba186a-bda3-4084-998d-dfbcf5c6f892 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.489020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb770-4603-446e-8e03-6440d237c77b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.494584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaabbe-3c86-4efb-b8ac-2b0d30da94d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.495438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaabbe-3c86-4efb-b8ac-2b0d30da94d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.495727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaabbe-3c86-4efb-b8ac-2b0d30da94d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.496541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaabbe-3c86-4efb-b8ac-2b0d30da94d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.497351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaabbe-3c86-4efb-b8ac-2b0d30da94d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.499915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaabbe-3c86-4efb-b8ac-2b0d30da94d2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.501164 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 793/1587] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.502113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb770-4603-446e-8e03-6440d237c77b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.512711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 795/1588] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.512874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb770-4603-446e-8e03-6440d237c77b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.513664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaabbe-3c86-4efb-b8ac-2b0d30da94d2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.519279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b1aab-8aff-4ef1-8c3c-0833482fe63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.519928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b1aab-8aff-4ef1-8c3c-0833482fe63c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.520209 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b1aab-8aff-4ef1-8c3c-0833482fe63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.520487 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b1aab-8aff-4ef1-8c3c-0833482fe63c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.521255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b1aab-8aff-4ef1-8c3c-0833482fe63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.522916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b1aab-8aff-4ef1-8c3c-0833482fe63c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.525017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaabbe-3c86-4efb-b8ac-2b0d30da94d2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.529680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0f0a7-de63-4f68-8076-64f3271ef72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.530318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0f0a7-de63-4f68-8076-64f3271ef72e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.530597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0f0a7-de63-4f68-8076-64f3271ef72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.530870 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0f0a7-de63-4f68-8076-64f3271ef72e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.531579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0f0a7-de63-4f68-8076-64f3271ef72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.536411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 794/1589] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.536553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0f0a7-de63-4f68-8076-64f3271ef72e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.536732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b1aab-8aff-4ef1-8c3c-0833482fe63c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.547209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 796/1590] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.547388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b1aab-8aff-4ef1-8c3c-0833482fe63c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.547491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e97ea-476e-448e-a409-cdc6f43a02d8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.547491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e97ea-476e-448e-a409-cdc6f43a02d8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.547491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e97ea-476e-448e-a409-cdc6f43a02d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.549437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eccc4-eaf5-4c2c-904b-2d6574400eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.550108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eccc4-eaf5-4c2c-904b-2d6574400eac admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.550400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eccc4-eaf5-4c2c-904b-2d6574400eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.550681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eccc4-eaf5-4c2c-904b-2d6574400eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.551412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76eccc4-eaf5-4c2c-904b-2d6574400eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.554109 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76eccc4-eaf5-4c2c-904b-2d6574400eac admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.563990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-372e97ea-476e-448e-a409-cdc6f43a02d8 None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:23.564175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 795/1591] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.564800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eccc4-eaf5-4c2c-904b-2d6574400eac admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.565243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-372e97ea-476e-448e-a409-cdc6f43a02d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:23.577521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eccc4-eaf5-4c2c-904b-2d6574400eac admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.582092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f73474-8404-4f6c-a479-d50c56833394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.582732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f73474-8404-4f6c-a479-d50c56833394 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.583020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f73474-8404-4f6c-a479-d50c56833394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.583298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f73474-8404-4f6c-a479-d50c56833394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.584645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f73474-8404-4f6c-a479-d50c56833394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.586280 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f73474-8404-4f6c-a479-d50c56833394 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.596604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 796/1592] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.600171 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f73474-8404-4f6c-a479-d50c56833394 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.607854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f73474-8404-4f6c-a479-d50c56833394 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.612460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a06d06-9ec8-4897-9053-397c39236267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.613106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a06d06-9ec8-4897-9053-397c39236267 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.613394 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a06d06-9ec8-4897-9053-397c39236267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.613706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a06d06-9ec8-4897-9053-397c39236267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.614424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a06d06-9ec8-4897-9053-397c39236267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.617056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a06d06-9ec8-4897-9053-397c39236267 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.627098 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 797/1593] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.627859 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a06d06-9ec8-4897-9053-397c39236267 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.637088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 797/1594] 10.222.0.90 () {58 vars in 1058 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:23.637988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e97ea-476e-448e-a409-cdc6f43a02d8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.638485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a06d06-9ec8-4897-9053-397c39236267 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.643255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3e005-1fab-495b-bf2f-3474e07878a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.644671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3e005-1fab-495b-bf2f-3474e07878a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.644967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3e005-1fab-495b-bf2f-3474e07878a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.645407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3e005-1fab-495b-bf2f-3474e07878a1 admin admin] PATH_INFO: `/v3/projects/39a4cc3525f049199b9e5ef1f3f5aa9e/users/67ff3d88fac84118b43dbe17caad5241/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.647884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e97ea-476e-448e-a409-cdc6f43a02d8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.652562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f03eb-6ff6-4e85-9aef-c012cefed797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.653226 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f03eb-6ff6-4e85-9aef-c012cefed797 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.653541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f03eb-6ff6-4e85-9aef-c012cefed797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.653822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f03eb-6ff6-4e85-9aef-c012cefed797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.654560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f03eb-6ff6-4e85-9aef-c012cefed797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.656207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f03eb-6ff6-4e85-9aef-c012cefed797 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.662830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3e005-1fab-495b-bf2f-3474e07878a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a4cc3525f049199b9e5ef1f3f5aa9e, user_id=67ff3d88fac84118b43dbe17caad5241, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.665576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3e005-1fab-495b-bf2f-3474e07878a1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.671530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 798/1595] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.671530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f03eb-6ff6-4e85-9aef-c012cefed797 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.681228 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f03eb-6ff6-4e85-9aef-c012cefed797 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.684144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 798/1596] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:23 2022] PUT /identity/v3/projects/39a4cc3525f049199b9e5ef1f3f5aa9e/users/67ff3d88fac84118b43dbe17caad5241/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:23.685056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3e005-1fab-495b-bf2f-3474e07878a1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.741199 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bc3e5-5198-4dee-8d0b-31df46f75fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.741922 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bc3e5-5198-4dee-8d0b-31df46f75fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.742212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bc3e5-5198-4dee-8d0b-31df46f75fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.742498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bc3e5-5198-4dee-8d0b-31df46f75fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.743405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bc3e5-5198-4dee-8d0b-31df46f75fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.745184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bc3e5-5198-4dee-8d0b-31df46f75fd7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.746649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:23.753069 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3e005-1fab-495b-bf2f-3474e07878a1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.758201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfc670-bf10-4ebe-bce5-5c2da0aa01c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.758374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 799/1597] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.759072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc670-bf10-4ebe-bce5-5c2da0aa01c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.759199 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bc3e5-5198-4dee-8d0b-31df46f75fd7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.759663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc670-bf10-4ebe-bce5-5c2da0aa01c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.760016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc670-bf10-4ebe-bce5-5c2da0aa01c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.760818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfc670-bf10-4ebe-bce5-5c2da0aa01c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.762588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfc670-bf10-4ebe-bce5-5c2da0aa01c4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.764846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:23.771245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bc3e5-5198-4dee-8d0b-31df46f75fd7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.777778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 799/1598] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.777778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfc670-bf10-4ebe-bce5-5c2da0aa01c4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.778056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b307c4-149a-42b8-ac1d-d77742ae8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.778056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b307c4-149a-42b8-ac1d-d77742ae8b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.778056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b307c4-149a-42b8-ac1d-d77742ae8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.778056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b307c4-149a-42b8-ac1d-d77742ae8b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.778449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b307c4-149a-42b8-ac1d-d77742ae8b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.779776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b307c4-149a-42b8-ac1d-d77742ae8b2b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.786101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfc670-bf10-4ebe-bce5-5c2da0aa01c4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.790811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 800/1599] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.791508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebe6d4-aaff-4545-821c-90ec48d38b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.791651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b307c4-149a-42b8-ac1d-d77742ae8b2b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.792221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebe6d4-aaff-4545-821c-90ec48d38b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.792505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebe6d4-aaff-4545-821c-90ec48d38b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.792782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebe6d4-aaff-4545-821c-90ec48d38b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.793604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebe6d4-aaff-4545-821c-90ec48d38b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.795222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebe6d4-aaff-4545-821c-90ec48d38b23 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.803656 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b307c4-149a-42b8-ac1d-d77742ae8b2b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.809375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 800/1600] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:23.809375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebe6d4-aaff-4545-821c-90ec48d38b23 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.809864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d415-a5ea-43f0-8e68-5cfa6f0b8e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.809864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d415-a5ea-43f0-8e68-5cfa6f0b8e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.810249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d415-a5ea-43f0-8e68-5cfa6f0b8e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.810528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d415-a5ea-43f0-8e68-5cfa6f0b8e03 admin admin] PATH_INFO: `/v3/projects/1d7389922c374cd4bc6e9505b6b4ad3e/users/ee7a49315d634014bc8e89b33c6355d4/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.826218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979d415-a5ea-43f0-8e68-5cfa6f0b8e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7389922c374cd4bc6e9505b6b4ad3e, user_id=ee7a49315d634014bc8e89b33c6355d4, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.828799 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979d415-a5ea-43f0-8e68-5cfa6f0b8e03 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.842819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 801/1601] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:23 2022] PUT /identity/v3/projects/1d7389922c374cd4bc6e9505b6b4ad3e/users/ee7a49315d634014bc8e89b33c6355d4/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:23.847163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d415-a5ea-43f0-8e68-5cfa6f0b8e03 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:23.886008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebe6d4-aaff-4545-821c-90ec48d38b23 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.915073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d415-a5ea-43f0-8e68-5cfa6f0b8e03 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:23.920196 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c154c2-adb9-4db5-9bc8-84d580ab622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.921138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c154c2-adb9-4db5-9bc8-84d580ab622d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.921427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c154c2-adb9-4db5-9bc8-84d580ab622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.921744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c154c2-adb9-4db5-9bc8-84d580ab622d admin admin] PATH_INFO: `/v3/projects/745e39d6522445af90a1704a724145c1/users/a3d6d14028984f8faa5918e0b64c64b3/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.937887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c154c2-adb9-4db5-9bc8-84d580ab622d admin admin] RBAC: Authorizing `identity:create_grant(project_id=745e39d6522445af90a1704a724145c1, user_id=a3d6d14028984f8faa5918e0b64c64b3, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:23.940570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c154c2-adb9-4db5-9bc8-84d580ab622d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:23.954989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 802/1602] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:23 2022] PUT /identity/v3/projects/745e39d6522445af90a1704a724145c1/users/a3d6d14028984f8faa5918e0b64c64b3/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:23.956368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656227d-e819-40bb-b4d9-c2be92b55e6b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.956759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656227d-e819-40bb-b4d9-c2be92b55e6b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.957161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656227d-e819-40bb-b4d9-c2be92b55e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.960020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6b8ed-4774-4449-8649-45244d48fadb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:23.960828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6b8ed-4774-4449-8649-45244d48fadb service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:23.961120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6b8ed-4774-4449-8649-45244d48fadb service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:23.961407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6b8ed-4774-4449-8649-45244d48fadb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:23.975505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9656227d-e819-40bb-b4d9-c2be92b55e6b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:23.976709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9656227d-e819-40bb-b4d9-c2be92b55e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:24.021692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6b8ed-4774-4449-8649-45244d48fadb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.023441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6b8ed-4774-4449-8649-45244d48fadb service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.032692 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 801/1603] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:24.033737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6b8ed-4774-4449-8649-45244d48fadb service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.041205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 803/1604] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:24.041916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656227d-e819-40bb-b4d9-c2be92b55e6b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.047241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6b8ed-4774-4449-8649-45244d48fadb service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.051736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656227d-e819-40bb-b4d9-c2be92b55e6b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.053285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548bdf9-add5-4462-a93f-f254f1f3a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.054644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548bdf9-add5-4462-a93f-f254f1f3a9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.054998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548bdf9-add5-4462-a93f-f254f1f3a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.055348 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548bdf9-add5-4462-a93f-f254f1f3a9ba admin admin] PATH_INFO: `/v3/projects/1d3375c9a37043308905b8613f2267f8/users/f8b281f5fe3847fb8f744894b73e7b81/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.057034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b83a6-731f-4c71-9813-8b6f15a34f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.057949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b83a6-731f-4c71-9813-8b6f15a34f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.058240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b83a6-731f-4c71-9813-8b6f15a34f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.058514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b83a6-731f-4c71-9813-8b6f15a34f89 admin admin] PATH_INFO: `/v3/projects/3dc16d6bbeca4354adb6b7149dca6e3b/users/d56ce8a772d7417eb4224f3e13cc0759/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.071463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548bdf9-add5-4462-a93f-f254f1f3a9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3375c9a37043308905b8613f2267f8, user_id=f8b281f5fe3847fb8f744894b73e7b81, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.073739 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b83a6-731f-4c71-9813-8b6f15a34f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc16d6bbeca4354adb6b7149dca6e3b, user_id=d56ce8a772d7417eb4224f3e13cc0759, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.074423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548bdf9-add5-4462-a93f-f254f1f3a9ba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.076385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b83a6-731f-4c71-9813-8b6f15a34f89 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.083383 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:24.091468 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 804/1605] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:24 2022] PUT /identity/v3/projects/3dc16d6bbeca4354adb6b7149dca6e3b/users/d56ce8a772d7417eb4224f3e13cc0759/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:24.095054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 802/1606] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:24 2022] PUT /identity/v3/projects/1d3375c9a37043308905b8613f2267f8/users/f8b281f5fe3847fb8f744894b73e7b81/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:24.095054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548bdf9-add5-4462-a93f-f254f1f3a9ba admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.095279 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b83a6-731f-4c71-9813-8b6f15a34f89 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.116943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:24.164677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548bdf9-add5-4462-a93f-f254f1f3a9ba admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.165653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b83a6-731f-4c71-9813-8b6f15a34f89 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.169485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6b487-e375-47b4-9ac7-66d9f0750b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.170536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6b487-e375-47b4-9ac7-66d9f0750b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.170915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6b487-e375-47b4-9ac7-66d9f0750b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.171017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e393-d7b2-4a03-b3e9-06f2bc9a18c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.171370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6b487-e375-47b4-9ac7-66d9f0750b64 admin admin] PATH_INFO: `/v3/projects/44761991b5db49f3bf73c9d5e6051dc8/users/a2eca36d7a4241d7b80f68380961014c/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.171812 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e393-d7b2-4a03-b3e9-06f2bc9a18c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.172100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e393-d7b2-4a03-b3e9-06f2bc9a18c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.172380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e393-d7b2-4a03-b3e9-06f2bc9a18c8 admin admin] PATH_INFO: `/v3/projects/e2ac1341e4c94d97b226d785888d5e03/users/873694a34f1f40128a9c2eeaaa8424cc/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.186701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6b487-e375-47b4-9ac7-66d9f0750b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44761991b5db49f3bf73c9d5e6051dc8, user_id=a2eca36d7a4241d7b80f68380961014c, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.189559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6b487-e375-47b4-9ac7-66d9f0750b64 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.189914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e393-d7b2-4a03-b3e9-06f2bc9a18c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ac1341e4c94d97b226d785888d5e03, user_id=873694a34f1f40128a9c2eeaaa8424cc, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.192553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34e393-d7b2-4a03-b3e9-06f2bc9a18c8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.203885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 803/1607] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:24 2022] PUT /identity/v3/projects/44761991b5db49f3bf73c9d5e6051dc8/users/a2eca36d7a4241d7b80f68380961014c/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:24.205268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d9d3-6649-46d8-ae13-4df3383bbfb8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.205699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d9d3-6649-46d8-ae13-4df3383bbfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.206199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d9d3-6649-46d8-ae13-4df3383bbfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.210565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 805/1608] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:24 2022] PUT /identity/v3/projects/e2ac1341e4c94d97b226d785888d5e03/users/873694a34f1f40128a9c2eeaaa8424cc/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:24.210565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bec5f-f9fb-42b9-9089-bf454f81ea52 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.210565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bec5f-f9fb-42b9-9089-bf454f81ea52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.210565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bec5f-f9fb-42b9-9089-bf454f81ea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.228561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c4f2d9d3-6649-46d8-ae13-4df3383bbfb8 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:24.230060 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c4f2d9d3-6649-46d8-ae13-4df3383bbfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:24.238230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0d6bec5f-f9fb-42b9-9089-bf454f81ea52 None None] MFA Rules not processed for user `a3d6d14028984f8faa5918e0b64c64b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:24.239637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0d6bec5f-f9fb-42b9-9089-bf454f81ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:24.298203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 804/1609] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:24.299063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d9d3-6649-46d8-ae13-4df3383bbfb8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.316841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 806/1610] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:24.319013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa410964-4a20-43f4-afb6-d64a5c596d90 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.319631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa410964-4a20-43f4-afb6-d64a5c596d90 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.320010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa410964-4a20-43f4-afb6-d64a5c596d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.338527 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-aa410964-4a20-43f4-afb6-d64a5c596d90 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:24.339603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aa410964-4a20-43f4-afb6-d64a5c596d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:24.347362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 807/1611] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:24.348667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6084c8-7705-473d-8d17-56b4c07f5822 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.348962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6084c8-7705-473d-8d17-56b4c07f5822 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.349417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6084c8-7705-473d-8d17-56b4c07f5822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.367754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5d6084c8-7705-473d-8d17-56b4c07f5822 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:24.367976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d9d3-6649-46d8-ae13-4df3383bbfb8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.369117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5d6084c8-7705-473d-8d17-56b4c07f5822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:24.371772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fac59-dd80-4ed4-a39e-ed9d09825832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.372422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fac59-dd80-4ed4-a39e-ed9d09825832 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.372704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fac59-dd80-4ed4-a39e-ed9d09825832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.372978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fac59-dd80-4ed4-a39e-ed9d09825832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.381948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 808/1612] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:24.381948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d2ba7-6e3f-46a8-b2ba-f28245857047 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.381948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d2ba7-6e3f-46a8-b2ba-f28245857047 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.381948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d2ba7-6e3f-46a8-b2ba-f28245857047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.388127 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fac59-dd80-4ed4-a39e-ed9d09825832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.389670 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fac59-dd80-4ed4-a39e-ed9d09825832 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.397859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1b5d2ba7-6e3f-46a8-b2ba-f28245857047 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:24.399042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1b5d2ba7-6e3f-46a8-b2ba-f28245857047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:24.400801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 805/1613] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:24.402099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7b37-3906-40bf-9ad4-afc09b283237 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.402391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7b37-3906-40bf-9ad4-afc09b283237 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.402694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7b37-3906-40bf-9ad4-afc09b283237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.410847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 809/1614] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:24.410847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f75ea-5cb1-4589-b047-4f2cbf718930 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.410847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f75ea-5cb1-4589-b047-4f2cbf718930 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.410847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f75ea-5cb1-4589-b047-4f2cbf718930 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.411813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 810/1615] 10.222.0.90 () {54 vars in 912 bytes} [Tue Jun 21 15:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:13:24.412576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f75ea-5cb1-4589-b047-4f2cbf718930 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.429932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c83f7b37-3906-40bf-9ad4-afc09b283237 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:24.431004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f75ea-5cb1-4589-b047-4f2cbf718930 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.431195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c83f7b37-3906-40bf-9ad4-afc09b283237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:24.434946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520280-e8c0-4901-a9c1-56a48fbf63ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.435655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520280-e8c0-4901-a9c1-56a48fbf63ad service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.435868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520280-e8c0-4901-a9c1-56a48fbf63ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.436147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520280-e8c0-4901-a9c1-56a48fbf63ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.440065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 806/1616] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:24.440765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7b37-3906-40bf-9ad4-afc09b283237 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.447198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60520280-e8c0-4901-a9c1-56a48fbf63ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.449174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60520280-e8c0-4901-a9c1-56a48fbf63ad service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.461741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 811/1617] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:24.462710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520280-e8c0-4901-a9c1-56a48fbf63ad service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.465821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:24.473316 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520280-e8c0-4901-a9c1-56a48fbf63ad service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.480007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545365be-6b54-4bab-8a79-219390ac37ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.480618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545365be-6b54-4bab-8a79-219390ac37ee service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.481415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545365be-6b54-4bab-8a79-219390ac37ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.482273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545365be-6b54-4bab-8a79-219390ac37ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.496074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545365be-6b54-4bab-8a79-219390ac37ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.498179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545365be-6b54-4bab-8a79-219390ac37ee service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.510521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 812/1618] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:24.510694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7b37-3906-40bf-9ad4-afc09b283237 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.511231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545365be-6b54-4bab-8a79-219390ac37ee service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.516283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd787e2-185d-48d4-ac10-da7eafb7cd5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.517766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd787e2-185d-48d4-ac10-da7eafb7cd5d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.518122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd787e2-185d-48d4-ac10-da7eafb7cd5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.518466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd787e2-185d-48d4-ac10-da7eafb7cd5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.520552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545365be-6b54-4bab-8a79-219390ac37ee service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.525069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a19d-ce89-4ea5-9819-6fcf8ef1244c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.525798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a19d-ce89-4ea5-9819-6fcf8ef1244c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.526082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a19d-ce89-4ea5-9819-6fcf8ef1244c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.526367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a19d-ce89-4ea5-9819-6fcf8ef1244c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.530507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd787e2-185d-48d4-ac10-da7eafb7cd5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.531956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd787e2-185d-48d4-ac10-da7eafb7cd5d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.538114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069a19d-ce89-4ea5-9819-6fcf8ef1244c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.539277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069a19d-ce89-4ea5-9819-6fcf8ef1244c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.543494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 807/1619] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:24.544798 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be28c5-c9e9-4444-b539-63d5f5c12e20 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.545089 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be28c5-c9e9-4444-b539-63d5f5c12e20 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.545369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be28c5-c9e9-4444-b539-63d5f5c12e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.550164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 813/1620] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:24.550992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a19d-ce89-4ea5-9819-6fcf8ef1244c service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.560111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a19d-ce89-4ea5-9819-6fcf8ef1244c service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.564497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f199d-a51d-4a07-80c3-944811e2dbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.565331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f199d-a51d-4a07-80c3-944811e2dbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.565593 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e0be28c5-c9e9-4444-b539-63d5f5c12e20 None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:24.565802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f199d-a51d-4a07-80c3-944811e2dbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.566121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f199d-a51d-4a07-80c3-944811e2dbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.566791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0be28c5-c9e9-4444-b539-63d5f5c12e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:24.578650 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f199d-a51d-4a07-80c3-944811e2dbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.580232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f199d-a51d-4a07-80c3-944811e2dbc5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.602895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 814/1621] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:24.603929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f199d-a51d-4a07-80c3-944811e2dbc5 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.622112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f199d-a51d-4a07-80c3-944811e2dbc5 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.634924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56399838-f371-4095-9234-5fe07aeb7cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.635652 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399838-f371-4095-9234-5fe07aeb7cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.635943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399838-f371-4095-9234-5fe07aeb7cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.636269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56399838-f371-4095-9234-5fe07aeb7cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.655417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56399838-f371-4095-9234-5fe07aeb7cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.656885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56399838-f371-4095-9234-5fe07aeb7cd2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.685370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 815/1622] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:24.690196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 808/1623] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:24.706637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56399838-f371-4095-9234-5fe07aeb7cd2 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:24.719497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56399838-f371-4095-9234-5fe07aeb7cd2 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:24.723546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca437d-6d49-466e-a5cc-0bba953a0924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:24.724389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca437d-6d49-466e-a5cc-0bba953a0924 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:24.724737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca437d-6d49-466e-a5cc-0bba953a0924 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:24.725016 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca437d-6d49-466e-a5cc-0bba953a0924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:24.734076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:24.742960 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca437d-6d49-466e-a5cc-0bba953a0924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:24.745569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca437d-6d49-466e-a5cc-0bba953a0924 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:24.762257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 816/1624] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:26.007802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57a69-451e-48c2-b51e-d0b73744f994 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.008393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57a69-451e-48c2-b51e-d0b73744f994 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.008393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57a69-451e-48c2-b51e-d0b73744f994 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.010928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 809/1625] 10.222.0.90 () {54 vars in 961 bytes} [Tue Jun 21 15:13:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:13:26.021845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec2113-cf80-44c3-9357-b7cc2b20d539 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.023028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec2113-cf80-44c3-9357-b7cc2b20d539 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.023556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec2113-cf80-44c3-9357-b7cc2b20d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.046071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1bec2113-cf80-44c3-9357-b7cc2b20d539 None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:26.047560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1bec2113-cf80-44c3-9357-b7cc2b20d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:26.058610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 817/1626] 10.222.0.90 () {58 vars in 1058 bytes} [Tue Jun 21 15:13:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:26.063892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d7377-7d39-4e94-ad99-209ae950f1cf None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.064253 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d7377-7d39-4e94-ad99-209ae950f1cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.064437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d7377-7d39-4e94-ad99-209ae950f1cf None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.065969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 810/1627] 10.222.0.90 () {54 vars in 912 bytes} [Tue Jun 21 15:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:13:26.072347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd7c4c-50e9-4a88-a6e9-0427820c2523 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.072638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd7c4c-50e9-4a88-a6e9-0427820c2523 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.072986 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd7c4c-50e9-4a88-a6e9-0427820c2523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.097724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9fdd7c4c-50e9-4a88-a6e9-0427820c2523 None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:26.099277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9fdd7c4c-50e9-4a88-a6e9-0427820c2523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:26.114211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 818/1628] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:13:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:26.129228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d7377-7d39-4e94-ad99-209ae950f1cf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:26.149213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d7377-7d39-4e94-ad99-209ae950f1cf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:26.154725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2d4bc-5afb-42f6-9281-c22ae3513d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:26.155141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2d4bc-5afb-42f6-9281-c22ae3513d96 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.155444 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2d4bc-5afb-42f6-9281-c22ae3513d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.155709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2d4bc-5afb-42f6-9281-c22ae3513d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.183903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2d4bc-5afb-42f6-9281-c22ae3513d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:26.186102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2d4bc-5afb-42f6-9281-c22ae3513d96 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:26.201803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 811/1629] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:26.287707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7577-5cec-4d7c-a2db-dc2570f7eb40 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.288509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7577-5cec-4d7c-a2db-dc2570f7eb40 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.290048 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7577-5cec-4d7c-a2db-dc2570f7eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.412278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-923a7577-5cec-4d7c-a2db-dc2570f7eb40 None None] MFA Rules not processed for user `a2eca36d7a4241d7b80f68380961014c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:26.415485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-923a7577-5cec-4d7c-a2db-dc2570f7eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:26.528053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 819/1630] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:26.533400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2d4bc-5afb-42f6-9281-c22ae3513d96 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:26.548216 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2d4bc-5afb-42f6-9281-c22ae3513d96 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:26.553909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546e4fd-1738-45d3-bfcc-6a45b76e1231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:26.556088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546e4fd-1738-45d3-bfcc-6a45b76e1231 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.556485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546e4fd-1738-45d3-bfcc-6a45b76e1231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.557032 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546e4fd-1738-45d3-bfcc-6a45b76e1231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.558458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546e4fd-1738-45d3-bfcc-6a45b76e1231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:26.562362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546e4fd-1738-45d3-bfcc-6a45b76e1231 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:26.610870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 812/1631] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:26 2022] POST /identity/v3/projects => generated 405 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:26.616042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7577-5cec-4d7c-a2db-dc2570f7eb40 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:26.634103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7577-5cec-4d7c-a2db-dc2570f7eb40 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:26.783436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e72150-39e2-4b62-b3e9-40bc383597d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:26.785142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e72150-39e2-4b62-b3e9-40bc383597d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.785689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e72150-39e2-4b62-b3e9-40bc383597d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.786011 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e72150-39e2-4b62-b3e9-40bc383597d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.787651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e72150-39e2-4b62-b3e9-40bc383597d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:26.790297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e72150-39e2-4b62-b3e9-40bc383597d3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:26.836150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 820/1632] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:26 2022] POST /identity/v3/users => generated 309 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:26.836674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546e4fd-1738-45d3-bfcc-6a45b76e1231 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:26.848069 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546e4fd-1738-45d3-bfcc-6a45b76e1231 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:26.854039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a0c9-23a0-4a38-90e6-db5ac5ed6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:26.854780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a0c9-23a0-4a38-90e6-db5ac5ed6205 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.855066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a0c9-23a0-4a38-90e6-db5ac5ed6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.855346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0a0c9-23a0-4a38-90e6-db5ac5ed6205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.856086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a0c9-23a0-4a38-90e6-db5ac5ed6205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:26.857815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0a0c9-23a0-4a38-90e6-db5ac5ed6205 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:26.870515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 813/1633] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:26.874386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e72150-39e2-4b62-b3e9-40bc383597d3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:26.889791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e72150-39e2-4b62-b3e9-40bc383597d3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:26.903249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed07551-2c1c-46ac-9d0e-650cd850c9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:26.904436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed07551-2c1c-46ac-9d0e-650cd850c9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:26.904941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed07551-2c1c-46ac-9d0e-650cd850c9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:26.905062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed07551-2c1c-46ac-9d0e-650cd850c9a9 admin admin] PATH_INFO: `/v3/projects/316933f2a96847e8bfd999ad6b472a2f/users/5c458b243c0041ee90bfad5d40eb911d/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:26.946664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed07551-2c1c-46ac-9d0e-650cd850c9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316933f2a96847e8bfd999ad6b472a2f, user_id=5c458b243c0041ee90bfad5d40eb911d, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:26.952584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed07551-2c1c-46ac-9d0e-650cd850c9a9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:26.981921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 821/1634] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:26 2022] PUT /identity/v3/projects/316933f2a96847e8bfd999ad6b472a2f/users/5c458b243c0041ee90bfad5d40eb911d/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:13:26.983004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a0c9-23a0-4a38-90e6-db5ac5ed6205 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:26.995329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0a0c9-23a0-4a38-90e6-db5ac5ed6205 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:27.135429 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c22a57-a9ca-4326-a4b5-08b4889972e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:27.136293 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c22a57-a9ca-4326-a4b5-08b4889972e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:27.136582 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c22a57-a9ca-4326-a4b5-08b4889972e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:27.137319 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c22a57-a9ca-4326-a4b5-08b4889972e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:27.137685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c22a57-a9ca-4326-a4b5-08b4889972e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:27.141657 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c22a57-a9ca-4326-a4b5-08b4889972e9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:27.165136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed07551-2c1c-46ac-9d0e-650cd850c9a9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:27.180637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 814/1635] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:13:27.188860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed07551-2c1c-46ac-9d0e-650cd850c9a9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:27.195505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d86f70-6acd-400e-ad9c-99eb170f17ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:27.196779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d86f70-6acd-400e-ad9c-99eb170f17ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:27.197124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d86f70-6acd-400e-ad9c-99eb170f17ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:27.197530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d86f70-6acd-400e-ad9c-99eb170f17ee admin admin] PATH_INFO: `/v3/projects/316933f2a96847e8bfd999ad6b472a2f/users/5c458b243c0041ee90bfad5d40eb911d/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:27.200597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d86f70-6acd-400e-ad9c-99eb170f17ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=316933f2a96847e8bfd999ad6b472a2f, user_id=5c458b243c0041ee90bfad5d40eb911d, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:27.205541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d86f70-6acd-400e-ad9c-99eb170f17ee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:27.233729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 822/1636] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:27 2022] PUT /identity/v3/projects/316933f2a96847e8bfd999ad6b472a2f/users/5c458b243c0041ee90bfad5d40eb911d/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:28.781662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c22a57-a9ca-4326-a4b5-08b4889972e9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:28.789357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:28.803075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c22a57-a9ca-4326-a4b5-08b4889972e9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:28.868199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:28.869414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:28.869888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:28.870323 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] PATH_INFO: `/v3/users/f72295caacba4e8b818e13b445be3a24` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:28.871815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72295caacba4e8b818e13b445be3a24)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:28.873128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:13:28.873128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: warnings.warn(msg) Jun 21 15:13:28.873128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: Jun 21 15:13:28.874778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:28.959708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72295caacba4e8b818e13b445be3a24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:28.982899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72295caacba4e8b818e13b445be3a24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:28.993104 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72295caacba4e8b818e13b445be3a24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:29.009659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72295caacba4e8b818e13b445be3a24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:29.010667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72295caacba4e8b818e13b445be3a24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:29.018645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 815/1637] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:28 2022] DELETE /identity/v3/users/f72295caacba4e8b818e13b445be3a24 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:29.023448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948312f-5409-452d-bbd8-b2e31122fe6f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:29.024332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948312f-5409-452d-bbd8-b2e31122fe6f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:29.024894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948312f-5409-452d-bbd8-b2e31122fe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:29.044715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2948312f-5409-452d-bbd8-b2e31122fe6f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:29.046283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2948312f-5409-452d-bbd8-b2e31122fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:29.067212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:29.164408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 823/1638] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:29.178429 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:29.182880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:29.220692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a858c29-2cb9-4f6c-aea9-3e00ecc80257 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:29.220692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a858c29-2cb9-4f6c-aea9-3e00ecc80257 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:29.220692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a858c29-2cb9-4f6c-aea9-3e00ecc80257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:29.254873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3a858c29-2cb9-4f6c-aea9-3e00ecc80257 None None] MFA Rules not processed for user `5c458b243c0041ee90bfad5d40eb911d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:29.256751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a858c29-2cb9-4f6c-aea9-3e00ecc80257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:29.280238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5913d88-2839-4b69-bae4-39bb0edf09ea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:29.286075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc39e85-8bba-47aa-bc09-21c1d6bcfec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:29.287676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc39e85-8bba-47aa-bc09-21c1d6bcfec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:29.287885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc39e85-8bba-47aa-bc09-21c1d6bcfec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:29.288111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc39e85-8bba-47aa-bc09-21c1d6bcfec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:29.306140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc39e85-8bba-47aa-bc09-21c1d6bcfec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:29.324672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc39e85-8bba-47aa-bc09-21c1d6bcfec1 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:29.351743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 816/1639] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:29.403724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 824/1640] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:30.498652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc39e85-8bba-47aa-bc09-21c1d6bcfec1 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:30.500205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4fc39e85-8bba-47aa-bc09-21c1d6bcfec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:30.552542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc39e85-8bba-47aa-bc09-21c1d6bcfec1 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:30.567573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:30.570440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:30.573029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:30.574181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] PATH_INFO: `/v3/projects/49ed2d170ec6473a889d9c344f403355` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:30.587273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ed2d170ec6473a889d9c344f403355)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:30.590619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:30.631804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:30.679320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ed2d170ec6473a889d9c344f403355', 'request_id': 'req-f27c4961-ec20-4fbf-aab4-d0d574d403c9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:30.693092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ed2d170ec6473a889d9c344f403355', 'request_id': 'req-f27c4961-ec20-4fbf-aab4-d0d574d403c9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:30.704092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ed2d170ec6473a889d9c344f403355', 'request_id': 'req-f27c4961-ec20-4fbf-aab4-d0d574d403c9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:30.719635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] The token cache is being invalidate because project 49ed2d170ec6473a889d9c344f403355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:13:30.720242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:30.721157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f27c4961-ec20-4fbf-aab4-d0d574d403c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:30.723437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 817/1641] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:13:30 2022] DELETE /identity/v3/projects/49ed2d170ec6473a889d9c344f403355 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:30.732612 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44874-b330-4d9c-bb91-4e4caab21b97 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:30.733636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44874-b330-4d9c-bb91-4e4caab21b97 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:30.734063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44874-b330-4d9c-bb91-4e4caab21b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:30.787433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4ab44874-b330-4d9c-bb91-4e4caab21b97 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:30.796062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ab44874-b330-4d9c-bb91-4e4caab21b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:30.967720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 825/1642] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:30.968168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1764f73-6778-4fe4-996e-a1060c4b7469 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:30.968469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1764f73-6778-4fe4-996e-a1060c4b7469 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:30.968753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1764f73-6778-4fe4-996e-a1060c4b7469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.028476 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a1764f73-6778-4fe4-996e-a1060c4b7469 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:31.036782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a1764f73-6778-4fe4-996e-a1060c4b7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:31.085239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab44874-b330-4d9c-bb91-4e4caab21b97 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:31.086437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 818/1643] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:31.102046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab44874-b330-4d9c-bb91-4e4caab21b97 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:31.132879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cc05c-15b9-44d8-aea0-1e4888b36ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:31.133820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cc05c-15b9-44d8-aea0-1e4888b36ece admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.134248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cc05c-15b9-44d8-aea0-1e4888b36ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.134844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cc05c-15b9-44d8-aea0-1e4888b36ece admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.135733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cc05c-15b9-44d8-aea0-1e4888b36ece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:31.136451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cc05c-15b9-44d8-aea0-1e4888b36ece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:31.139064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cc05c-15b9-44d8-aea0-1e4888b36ece admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:31.164784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 826/1644] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:31.165850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1764f73-6778-4fe4-996e-a1060c4b7469 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:31.182686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1764f73-6778-4fe4-996e-a1060c4b7469 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:31.198651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f62c84-4618-4ee4-8572-db957143e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:31.199577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f62c84-4618-4ee4-8572-db957143e809 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.200200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f62c84-4618-4ee4-8572-db957143e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.200611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f62c84-4618-4ee4-8572-db957143e809 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.201460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f62c84-4618-4ee4-8572-db957143e809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:31.203786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f62c84-4618-4ee4-8572-db957143e809 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:31.285010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cc05c-15b9-44d8-aea0-1e4888b36ece admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:31.294988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 819/1645] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:31 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:31.303331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cc05c-15b9-44d8-aea0-1e4888b36ece admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:31.394661 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:31.490410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb417d1-ed5f-484c-9904-46b16fa6a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:31.491298 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb417d1-ed5f-484c-9904-46b16fa6a471 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.491602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb417d1-ed5f-484c-9904-46b16fa6a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.491861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb417d1-ed5f-484c-9904-46b16fa6a471 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.492578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb417d1-ed5f-484c-9904-46b16fa6a471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:31.494607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb417d1-ed5f-484c-9904-46b16fa6a471 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:31.551701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f62c84-4618-4ee4-8572-db957143e809 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:31.558773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 827/1646] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:31 2022] POST /identity/v3/users => generated 284 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:31.578716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58efd-68b4-4f96-a14c-d2b28930ee3c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.579011 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58efd-68b4-4f96-a14c-d2b28930ee3c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.579296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca58efd-68b4-4f96-a14c-d2b28930ee3c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.587517 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f62c84-4618-4ee4-8572-db957143e809 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:31.588436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 828/1647] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:13:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:13:31.607177 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c40cf5-0a89-4190-be8d-5958aed09ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:31.610560 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40cf5-0a89-4190-be8d-5958aed09ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.611008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40cf5-0a89-4190-be8d-5958aed09ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.611643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40cf5-0a89-4190-be8d-5958aed09ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.612599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c40cf5-0a89-4190-be8d-5958aed09ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:31.615449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c40cf5-0a89-4190-be8d-5958aed09ac3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:31.620644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc585d27-b8bf-46e9-ac59-348564d1f5c8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.621142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc585d27-b8bf-46e9-ac59-348564d1f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.621626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc585d27-b8bf-46e9-ac59-348564d1f5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.657549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 820/1648] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:31.660452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c40cf5-0a89-4190-be8d-5958aed09ac3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:31.667987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fc585d27-b8bf-46e9-ac59-348564d1f5c8 None None] MFA Rules not processed for user `5e916fba8123451587f5e13568630015`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:31.672888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fc585d27-b8bf-46e9-ac59-348564d1f5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:31.686198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c40cf5-0a89-4190-be8d-5958aed09ac3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:31.718315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde4a42-4722-4520-806f-f907359dffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:31.719232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4a42-4722-4520-806f-f907359dffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.719850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4a42-4722-4520-806f-f907359dffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.721971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde4a42-4722-4520-806f-f907359dffb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.722933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde4a42-4722-4520-806f-f907359dffb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:31.732870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde4a42-4722-4520-806f-f907359dffb8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:31.783023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 821/1649] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:31.784252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde4a42-4722-4520-806f-f907359dffb8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:31.807456 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde4a42-4722-4520-806f-f907359dffb8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:31.872877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528713a4-0f4d-46c3-a8be-20c6bdb0012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:31.873846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528713a4-0f4d-46c3-a8be-20c6bdb0012a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.874435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528713a4-0f4d-46c3-a8be-20c6bdb0012a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.875087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528713a4-0f4d-46c3-a8be-20c6bdb0012a admin admin] PATH_INFO: `/v3/projects/d8b4f20938554072a030b2d5e911e95c/users/c8e2e9c71e254696a439248015d8af12/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.894414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528713a4-0f4d-46c3-a8be-20c6bdb0012a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b4f20938554072a030b2d5e911e95c, user_id=c8e2e9c71e254696a439248015d8af12, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:31.898449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528713a4-0f4d-46c3-a8be-20c6bdb0012a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:31.929273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 822/1650] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:31 2022] PUT /identity/v3/projects/d8b4f20938554072a030b2d5e911e95c/users/c8e2e9c71e254696a439248015d8af12/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:31.935475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 829/1651] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:13:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:13:31.945443 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543a6b3-ccff-44ac-92e8-4729af9449a7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.945786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543a6b3-ccff-44ac-92e8-4729af9449a7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.946398 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543a6b3-ccff-44ac-92e8-4729af9449a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:31.998908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82ca72-56d2-43cc-a598-73be54318bf4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:31.999413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82ca72-56d2-43cc-a598-73be54318bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:31.999803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82ca72-56d2-43cc-a598-73be54318bf4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:32.001788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 830/1652] 10.222.0.90 () {54 vars in 960 bytes} [Tue Jun 21 15:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 15:13:32.007913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6844fef-3314-44d8-b843-fe32fe388553 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:32.007913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6844fef-3314-44d8-b843-fe32fe388553 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:32.008557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6844fef-3314-44d8-b843-fe32fe388553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:32.064512 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d6844fef-3314-44d8-b843-fe32fe388553 None None] MFA Rules not processed for user `5e916fba8123451587f5e13568630015`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:32.069912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d6844fef-3314-44d8-b843-fe32fe388553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:32.076087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7543a6b3-ccff-44ac-92e8-4729af9449a7 None None] MFA Rules not processed for user `c8e2e9c71e254696a439248015d8af12`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:32.084250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7543a6b3-ccff-44ac-92e8-4729af9449a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:32.255328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 823/1653] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:32.256304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543a6b3-ccff-44ac-92e8-4729af9449a7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:32.314752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:32.376355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 831/1654] 10.222.0.90 () {58 vars in 1057 bytes} [Tue Jun 21 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:13:32.386146 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6844fef-3314-44d8-b843-fe32fe388553 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:32.404822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6844fef-3314-44d8-b843-fe32fe388553 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:32.411241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543a6b3-ccff-44ac-92e8-4729af9449a7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:32.436284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace7f9-34b2-457e-81e8-c912e8b7bd5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:32.436975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace7f9-34b2-457e-81e8-c912e8b7bd5a service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:32.437267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace7f9-34b2-457e-81e8-c912e8b7bd5a service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:32.437582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace7f9-34b2-457e-81e8-c912e8b7bd5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:32.439978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a422948-ff86-4511-84a4-af7883e7dcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:32.440714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422948-ff86-4511-84a4-af7883e7dcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:32.441005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422948-ff86-4511-84a4-af7883e7dcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:32.441291 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a422948-ff86-4511-84a4-af7883e7dcd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:32.442081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a422948-ff86-4511-84a4-af7883e7dcd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:32.445190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a422948-ff86-4511-84a4-af7883e7dcd4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:32.471626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ace7f9-34b2-457e-81e8-c912e8b7bd5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:32.476608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ace7f9-34b2-457e-81e8-c912e8b7bd5a service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:32.499355 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 824/1655] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:32 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:32.514943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a422948-ff86-4511-84a4-af7883e7dcd4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:32.519692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 832/1656] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:32.691362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a422948-ff86-4511-84a4-af7883e7dcd4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:32.708615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57946477-0487-4199-8a80-4b0d1c811e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:32.710193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57946477-0487-4199-8a80-4b0d1c811e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:32.712451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57946477-0487-4199-8a80-4b0d1c811e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:32.712451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57946477-0487-4199-8a80-4b0d1c811e78 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:32.712451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57946477-0487-4199-8a80-4b0d1c811e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:32.718622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57946477-0487-4199-8a80-4b0d1c811e78 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:32.772088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 825/1657] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:32 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:13:32.773521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace7f9-34b2-457e-81e8-c912e8b7bd5a service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:32.790877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace7f9-34b2-457e-81e8-c912e8b7bd5a service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:32.806808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62199f-a03f-4e0c-9ef9-afb02f589071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:32.807498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62199f-a03f-4e0c-9ef9-afb02f589071 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:32.807792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62199f-a03f-4e0c-9ef9-afb02f589071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:32.808076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62199f-a03f-4e0c-9ef9-afb02f589071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:32.808815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62199f-a03f-4e0c-9ef9-afb02f589071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:32.810468 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62199f-a03f-4e0c-9ef9-afb02f589071 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:32.845180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57946477-0487-4199-8a80-4b0d1c811e78 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:32.859315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57946477-0487-4199-8a80-4b0d1c811e78 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:32.861095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 833/1658] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:32.880681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483676-1271-459b-9fd1-557b7ea40828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:32.881852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483676-1271-459b-9fd1-557b7ea40828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:32.882150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483676-1271-459b-9fd1-557b7ea40828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:32.882436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd483676-1271-459b-9fd1-557b7ea40828 admin admin] PATH_INFO: `/v3/projects/81e206835e31469687389c1f3adc8502/users/6d006e097cba40b7ab06c149a86f18e7/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:32.940768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd483676-1271-459b-9fd1-557b7ea40828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e206835e31469687389c1f3adc8502, user_id=6d006e097cba40b7ab06c149a86f18e7, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:32.951925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd483676-1271-459b-9fd1-557b7ea40828 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:32.983751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 826/1659] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:32 2022] PUT /identity/v3/projects/81e206835e31469687389c1f3adc8502/users/6d006e097cba40b7ab06c149a86f18e7/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:32.987833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62199f-a03f-4e0c-9ef9-afb02f589071 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:33.001968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62199f-a03f-4e0c-9ef9-afb02f589071 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:33.096171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:33.160864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f929008-a19b-4293-99e9-1f09831b7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:33.162776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f929008-a19b-4293-99e9-1f09831b7798 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:33.162970 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f929008-a19b-4293-99e9-1f09831b7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:33.163267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f929008-a19b-4293-99e9-1f09831b7798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:33.164021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f929008-a19b-4293-99e9-1f09831b7798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:33.169149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f929008-a19b-4293-99e9-1f09831b7798 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:33.199942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 834/1660] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:33.202231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483676-1271-459b-9fd1-557b7ea40828 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:33.231037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd483676-1271-459b-9fd1-557b7ea40828 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:33.257547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256bdd1-c086-4ad5-beea-26fe0349e929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:33.257547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256bdd1-c086-4ad5-beea-26fe0349e929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:33.257547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256bdd1-c086-4ad5-beea-26fe0349e929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:33.257547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256bdd1-c086-4ad5-beea-26fe0349e929 admin admin] PATH_INFO: `/v3/projects/81e206835e31469687389c1f3adc8502/users/6d006e097cba40b7ab06c149a86f18e7/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:33.266490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256bdd1-c086-4ad5-beea-26fe0349e929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e206835e31469687389c1f3adc8502, user_id=6d006e097cba40b7ab06c149a86f18e7, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:33.275642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256bdd1-c086-4ad5-beea-26fe0349e929 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:33.310683 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 827/1661] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:33 2022] PUT /identity/v3/projects/81e206835e31469687389c1f3adc8502/users/6d006e097cba40b7ab06c149a86f18e7/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:33.321848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcabc4-82da-4144-acdc-1b870687a332 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:33.322168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcabc4-82da-4144-acdc-1b870687a332 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:33.322665 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcabc4-82da-4144-acdc-1b870687a332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:33.385438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f0dcabc4-82da-4144-acdc-1b870687a332 None None] MFA Rules not processed for user `6d006e097cba40b7ab06c149a86f18e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:33.386757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0dcabc4-82da-4144-acdc-1b870687a332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:33.541681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 835/1662] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:33.549152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256bdd1-c086-4ad5-beea-26fe0349e929 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:33.551205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2256bdd1-c086-4ad5-beea-26fe0349e929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:33.720080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256bdd1-c086-4ad5-beea-26fe0349e929 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:33.741300 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c923d-888d-4d3e-8a89-4705ad80d5f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:33.742167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c923d-888d-4d3e-8a89-4705ad80d5f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:33.742559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c923d-888d-4d3e-8a89-4705ad80d5f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:33.742950 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c923d-888d-4d3e-8a89-4705ad80d5f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:33.766471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c923d-888d-4d3e-8a89-4705ad80d5f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:33.768043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c923d-888d-4d3e-8a89-4705ad80d5f2 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:33.801868 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 828/1663] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:33.893029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcabc4-82da-4144-acdc-1b870687a332 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:33.897313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0dcabc4-82da-4144-acdc-1b870687a332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:33.939564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcabc4-82da-4144-acdc-1b870687a332 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:33.946633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c2edc-f9b2-40b5-b40e-2759c266ab66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:33.947797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c2edc-f9b2-40b5-b40e-2759c266ab66 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:33.948325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c2edc-f9b2-40b5-b40e-2759c266ab66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:33.948843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c2edc-f9b2-40b5-b40e-2759c266ab66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:34.040838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c2edc-f9b2-40b5-b40e-2759c266ab66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:34.042615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c2edc-f9b2-40b5-b40e-2759c266ab66 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:34.055598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 836/1664] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:35.013644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bab0d-4f42-4dba-8d17-4ed36d7de29d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:35.014586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bab0d-4f42-4dba-8d17-4ed36d7de29d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:35.015036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bab0d-4f42-4dba-8d17-4ed36d7de29d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:35.016871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 829/1665] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:13:35.042057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80793e68-ed78-4733-a944-83d5a3089159 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:35.042964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80793e68-ed78-4733-a944-83d5a3089159 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:35.048288 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80793e68-ed78-4733-a944-83d5a3089159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:35.092328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-80793e68-ed78-4733-a944-83d5a3089159 None None] MFA Rules not processed for user `5e916fba8123451587f5e13568630015`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:35.094187 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80793e68-ed78-4733-a944-83d5a3089159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:35.227558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:35.262534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 837/1666] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:35.344886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bab0d-4f42-4dba-8d17-4ed36d7de29d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:35.354008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:35.363361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bab0d-4f42-4dba-8d17-4ed36d7de29d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:35.378471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1afeb0-0f82-4a70-864e-1d07132001ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:35.379524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1afeb0-0f82-4a70-864e-1d07132001ef service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:35.379951 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1afeb0-0f82-4a70-864e-1d07132001ef service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:35.381123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1afeb0-0f82-4a70-864e-1d07132001ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:35.405745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1afeb0-0f82-4a70-864e-1d07132001ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:35.407376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1afeb0-0f82-4a70-864e-1d07132001ef service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:35.452099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80793e68-ed78-4733-a944-83d5a3089159 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:35.453686 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80793e68-ed78-4733-a944-83d5a3089159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:35.478124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 830/1667] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:35.633324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80793e68-ed78-4733-a944-83d5a3089159 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:35.647551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:35.648657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:35.649175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:35.649438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] PATH_INFO: `/v3/users/a2eca36d7a4241d7b80f68380961014c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:35.651297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2eca36d7a4241d7b80f68380961014c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:35.661582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:35.772405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2eca36d7a4241d7b80f68380961014c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:35.800944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2eca36d7a4241d7b80f68380961014c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:35.820198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2eca36d7a4241d7b80f68380961014c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:35.821859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2eca36d7a4241d7b80f68380961014c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:35.822709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2eca36d7a4241d7b80f68380961014c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:35.874483 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 838/1668] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:35 2022] DELETE /identity/v3/users/a2eca36d7a4241d7b80f68380961014c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:37.095113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1afeb0-0f82-4a70-864e-1d07132001ef service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:37.116758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1afeb0-0f82-4a70-864e-1d07132001ef service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:37.192486 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:37.194779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:37.221197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:37.222624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:37.223081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:37.223526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] PATH_INFO: `/v3/projects/44761991b5db49f3bf73c9d5e6051dc8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:37.226379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44761991b5db49f3bf73c9d5e6051dc8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:37.229204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:37.331823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b9219-428f-45d0-94e7-3388867bf6d7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:37.360467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:37.363968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44761991b5db49f3bf73c9d5e6051dc8', 'request_id': 'req-cb737251-3a38-4714-b4e7-bb3b6022c082'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.381397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44761991b5db49f3bf73c9d5e6051dc8', 'request_id': 'req-cb737251-3a38-4714-b4e7-bb3b6022c082'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.404625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44761991b5db49f3bf73c9d5e6051dc8', 'request_id': 'req-cb737251-3a38-4714-b4e7-bb3b6022c082'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.420178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] The token cache is being invalidate because project 44761991b5db49f3bf73c9d5e6051dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:13:37.420699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.421721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.424017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 831/1669] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:13:37 2022] DELETE /identity/v3/projects/44761991b5db49f3bf73c9d5e6051dc8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:37.429166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:37.430875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:37.484227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:37.485378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:37.485784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:37.485975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] PATH_INFO: `/v3/users/a3d6d14028984f8faa5918e0b64c64b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:37.491918 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d6d14028984f8faa5918e0b64c64b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:37.494268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:37.524938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb737251-3a38-4714-b4e7-bb3b6022c082 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:37.531167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:37.532609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:37.535416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:37.535746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] PATH_INFO: `/v3/users/5c458b243c0041ee90bfad5d40eb911d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:37.540472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c458b243c0041ee90bfad5d40eb911d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:37.548512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:37.590545 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:37.592601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d6d14028984f8faa5918e0b64c64b3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.625451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d6d14028984f8faa5918e0b64c64b3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.633651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c458b243c0041ee90bfad5d40eb911d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.645527 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d6d14028984f8faa5918e0b64c64b3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.646825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d6d14028984f8faa5918e0b64c64b3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.651163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-400209c2-edf7-43bc-b77c-a89e035dae5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d6d14028984f8faa5918e0b64c64b3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.653457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c458b243c0041ee90bfad5d40eb911d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.670862 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c458b243c0041ee90bfad5d40eb911d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.683574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 839/1670] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:37 2022] DELETE /identity/v3/users/a3d6d14028984f8faa5918e0b64c64b3 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:37.689302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61632b05-d8d9-4acc-b3a9-0c43ad432671 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:37.689490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c458b243c0041ee90bfad5d40eb911d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.689623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61632b05-d8d9-4acc-b3a9-0c43ad432671 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:37.690036 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61632b05-d8d9-4acc-b3a9-0c43ad432671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:37.690134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c458b243c0041ee90bfad5d40eb911d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:37.702071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 832/1671] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:37 2022] DELETE /identity/v3/users/5c458b243c0041ee90bfad5d40eb911d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:37.725788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-61632b05-d8d9-4acc-b3a9-0c43ad432671 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:37.727035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61632b05-d8d9-4acc-b3a9-0c43ad432671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:37.924549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 840/1672] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:13:38.092111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:38.094071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:38.279338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012ada0-1e6b-4e0d-a207-711458759176 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:38.292209 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c45fb-3d74-4277-ad9d-9e3d59837ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:38.292894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c45fb-3d74-4277-ad9d-9e3d59837ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:38.293183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c45fb-3d74-4277-ad9d-9e3d59837ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:38.293464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c45fb-3d74-4277-ad9d-9e3d59837ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:38.329170 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c45fb-3d74-4277-ad9d-9e3d59837ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:38.332537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c45fb-3d74-4277-ad9d-9e3d59837ca2 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:38.421515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 833/1673] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:39.090716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61632b05-d8d9-4acc-b3a9-0c43ad432671 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:39.092977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61632b05-d8d9-4acc-b3a9-0c43ad432671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:39.110204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61632b05-d8d9-4acc-b3a9-0c43ad432671 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:39.122265 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:39.123392 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:39.123821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:39.124299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] PATH_INFO: `/v3/users/c8e2e9c71e254696a439248015d8af12` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:39.128387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e2e9c71e254696a439248015d8af12)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:39.131453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:39.212298 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:39.235913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e2e9c71e254696a439248015d8af12'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.262004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e2e9c71e254696a439248015d8af12'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.282592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e2e9c71e254696a439248015d8af12'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.283618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e2e9c71e254696a439248015d8af12'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.284250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e2e9c71e254696a439248015d8af12'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.313263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 841/1674] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:39 2022] DELETE /identity/v3/users/c8e2e9c71e254696a439248015d8af12 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:39.320132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4e172-bae4-4d2b-9595-e9b02789d0d2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:39.320542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4e172-bae4-4d2b-9595-e9b02789d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:39.320726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4e172-bae4-4d2b-9595-e9b02789d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:39.360081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a0d4e172-bae4-4d2b-9595-e9b02789d0d2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:39.361242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a0d4e172-bae4-4d2b-9595-e9b02789d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:39.462131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:39.463596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:39.492818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 834/1675] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:39.579352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4e172-bae4-4d2b-9595-e9b02789d0d2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:39.581843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a0d4e172-bae4-4d2b-9595-e9b02789d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:39.590904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cec35-b246-4ece-9d5c-b69949cfc003 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:39.613371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:39.614661 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:39.615255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:39.618350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] PATH_INFO: `/v3/projects/316933f2a96847e8bfd999ad6b472a2f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:39.620790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316933f2a96847e8bfd999ad6b472a2f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:39.622059 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 15:13:39.622059 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: warnings.warn(msg) Jun 21 15:13:39.622059 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: Jun 21 15:13:39.623612 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:39.726730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316933f2a96847e8bfd999ad6b472a2f', 'request_id': 'req-5a923693-ea59-4cce-b330-47ee4ad1cad7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.728722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:39.756275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4e172-bae4-4d2b-9595-e9b02789d0d2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:39.759507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316933f2a96847e8bfd999ad6b472a2f', 'request_id': 'req-5a923693-ea59-4cce-b330-47ee4ad1cad7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.776649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316933f2a96847e8bfd999ad6b472a2f', 'request_id': 'req-5a923693-ea59-4cce-b330-47ee4ad1cad7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.813311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] The token cache is being invalidate because project 316933f2a96847e8bfd999ad6b472a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:13:39.813683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.818904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a923693-ea59-4cce-b330-47ee4ad1cad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:39.829579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 842/1676] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:13:39 2022] DELETE /identity/v3/projects/316933f2a96847e8bfd999ad6b472a2f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:39.834514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2592cbb-3dc0-45d7-8fe8-3d50dcd5759a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:39.834809 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2592cbb-3dc0-45d7-8fe8-3d50dcd5759a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:39.835795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2592cbb-3dc0-45d7-8fe8-3d50dcd5759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:39.879803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d2592cbb-3dc0-45d7-8fe8-3d50dcd5759a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:39.881733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d2592cbb-3dc0-45d7-8fe8-3d50dcd5759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:39.928758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea2be6-22ed-475c-aa30-1816d864d565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:39.929464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea2be6-22ed-475c-aa30-1816d864d565 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:39.936733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea2be6-22ed-475c-aa30-1816d864d565 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:39.936992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea2be6-22ed-475c-aa30-1816d864d565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:39.939536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b3ea2be6-22ed-475c-aa30-1816d864d565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:39.991173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:40.080367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 843/1677] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:40.085020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea96ed-7b65-4479-ad7e-3f4332671049 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:40.087424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea96ed-7b65-4479-ad7e-3f4332671049 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:40.087762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea96ed-7b65-4479-ad7e-3f4332671049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:40.141278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea2be6-22ed-475c-aa30-1816d864d565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:40.144567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6dea96ed-7b65-4479-ad7e-3f4332671049 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:40.146540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea2be6-22ed-475c-aa30-1816d864d565 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:40.146771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6dea96ed-7b65-4479-ad7e-3f4332671049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:40.160469 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 844/1678] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:40.162794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea96ed-7b65-4479-ad7e-3f4332671049 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:40.174334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea96ed-7b65-4479-ad7e-3f4332671049 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:40.180091 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5629f-bfec-4b3d-8601-e70bade89093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:40.180969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5629f-bfec-4b3d-8601-e70bade89093 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:40.181438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5629f-bfec-4b3d-8601-e70bade89093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:40.182695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5629f-bfec-4b3d-8601-e70bade89093 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:40.183621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5629f-bfec-4b3d-8601-e70bade89093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:40.184102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5629f-bfec-4b3d-8601-e70bade89093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:40.186819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5629f-bfec-4b3d-8601-e70bade89093 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:40.189730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 835/1679] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:13:40.208969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 845/1680] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:40.209946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea2be6-22ed-475c-aa30-1816d864d565 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:40.221647 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea2be6-22ed-475c-aa30-1816d864d565 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:40.232707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae9d9-a2bc-48de-901e-d1f8ade46f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:40.233388 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae9d9-a2bc-48de-901e-d1f8ade46f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:40.233765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae9d9-a2bc-48de-901e-d1f8ade46f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:40.234053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae9d9-a2bc-48de-901e-d1f8ade46f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:40.234756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae9d9-a2bc-48de-901e-d1f8ade46f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:40.236713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceae9d9-a2bc-48de-901e-d1f8ade46f61 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:40.300891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 836/1681] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:40 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:40.303857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5629f-bfec-4b3d-8601-e70bade89093 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:40.322180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5629f-bfec-4b3d-8601-e70bade89093 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:40.481804 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646bba4-0d9a-497b-b0d6-e28c1031f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:40.483333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646bba4-0d9a-497b-b0d6-e28c1031f524 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:40.484207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646bba4-0d9a-497b-b0d6-e28c1031f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:40.484608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646bba4-0d9a-497b-b0d6-e28c1031f524 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:40.486757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646bba4-0d9a-497b-b0d6-e28c1031f524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:40.489330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646bba4-0d9a-497b-b0d6-e28c1031f524 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:40.528372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 846/1682] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:40 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:40.533291 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae9d9-a2bc-48de-901e-d1f8ade46f61 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:40.554903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae9d9-a2bc-48de-901e-d1f8ade46f61 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:40.561215 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e16aae-00f8-4241-9fe0-834e1a7ab563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:40.562392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e16aae-00f8-4241-9fe0-834e1a7ab563 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:40.562792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e16aae-00f8-4241-9fe0-834e1a7ab563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:40.564249 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e16aae-00f8-4241-9fe0-834e1a7ab563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:40.566120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e16aae-00f8-4241-9fe0-834e1a7ab563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:40.569257 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e16aae-00f8-4241-9fe0-834e1a7ab563 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:40.591192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646bba4-0d9a-497b-b0d6-e28c1031f524 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:40.604412 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 837/1683] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:40.606433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646bba4-0d9a-497b-b0d6-e28c1031f524 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:40.624096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e69b5-6284-49d4-a148-17e96f68f197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:40.629887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e69b5-6284-49d4-a148-17e96f68f197 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:40.631126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e69b5-6284-49d4-a148-17e96f68f197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:40.635034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e69b5-6284-49d4-a148-17e96f68f197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:40.636000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e69b5-6284-49d4-a148-17e96f68f197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:40.637809 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e69b5-6284-49d4-a148-17e96f68f197 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:40.674077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 847/1684] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:40.674243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e16aae-00f8-4241-9fe0-834e1a7ab563 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:40.705315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e16aae-00f8-4241-9fe0-834e1a7ab563 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:40.722820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c01d4d-ecdd-4437-af6a-dfbe3b292060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:40.724750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c01d4d-ecdd-4437-af6a-dfbe3b292060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:40.729001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c01d4d-ecdd-4437-af6a-dfbe3b292060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:40.729461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c01d4d-ecdd-4437-af6a-dfbe3b292060 admin admin] PATH_INFO: `/v3/projects/9530fb891388460281b745ee4e54b6c0/users/26c55f1bdef749938b3cd8d66dcba755/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:40.778497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338f051-aeea-437b-8cec-91bdcecb61e9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:40.778727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c01d4d-ecdd-4437-af6a-dfbe3b292060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9530fb891388460281b745ee4e54b6c0, user_id=26c55f1bdef749938b3cd8d66dcba755, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:40.778943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338f051-aeea-437b-8cec-91bdcecb61e9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:40.779150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338f051-aeea-437b-8cec-91bdcecb61e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:40.788512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c01d4d-ecdd-4437-af6a-dfbe3b292060 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:40.836386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8338f051-aeea-437b-8cec-91bdcecb61e9 None None] MFA Rules not processed for user `67ff3d88fac84118b43dbe17caad5241`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:40.839886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8338f051-aeea-437b-8cec-91bdcecb61e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:40.867965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 838/1685] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:40 2022] PUT /identity/v3/projects/9530fb891388460281b745ee4e54b6c0/users/26c55f1bdef749938b3cd8d66dcba755/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:40.873273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721129ac-8789-44dc-b535-94f01a8fc02f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:40.873771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721129ac-8789-44dc-b535-94f01a8fc02f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:40.874096 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721129ac-8789-44dc-b535-94f01a8fc02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:40.980176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-721129ac-8789-44dc-b535-94f01a8fc02f None None] MFA Rules not processed for user `26c55f1bdef749938b3cd8d66dcba755`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:40.987608 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-721129ac-8789-44dc-b535-94f01a8fc02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:41.015253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 848/1686] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:41.023710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338f051-aeea-437b-8cec-91bdcecb61e9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:41.025442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8338f051-aeea-437b-8cec-91bdcecb61e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:41.072468 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:41.117794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:41.179154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 839/1687] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:41.182176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721129ac-8789-44dc-b535-94f01a8fc02f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:41.186985 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338f051-aeea-437b-8cec-91bdcecb61e9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:41.198386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4035c7-da1f-4725-9547-19d11b150d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:41.201524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4035c7-da1f-4725-9547-19d11b150d93 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:41.202046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4035c7-da1f-4725-9547-19d11b150d93 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:41.202525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4035c7-da1f-4725-9547-19d11b150d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:41.226121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4035c7-da1f-4725-9547-19d11b150d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:41.228108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4035c7-da1f-4725-9547-19d11b150d93 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:41.258326 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 849/1688] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:13:41.259519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4035c7-da1f-4725-9547-19d11b150d93 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:41.262904 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c4035c7-da1f-4725-9547-19d11b150d93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:41.374629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721129ac-8789-44dc-b535-94f01a8fc02f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:41.392399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370f9e7-f093-47f2-a13e-44083f4ffdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:41.394675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370f9e7-f093-47f2-a13e-44083f4ffdef admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:41.395184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370f9e7-f093-47f2-a13e-44083f4ffdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:41.397986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370f9e7-f093-47f2-a13e-44083f4ffdef admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:41.399919 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370f9e7-f093-47f2-a13e-44083f4ffdef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:41.405705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370f9e7-f093-47f2-a13e-44083f4ffdef admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:41.454521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4035c7-da1f-4725-9547-19d11b150d93 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:41.468846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:41.470539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:41.471954 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:41.474494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 840/1689] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:41 2022] POST /identity/v3/projects => generated 381 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:41.475202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] PATH_INFO: `/v3/projects/745e39d6522445af90a1704a724145c1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:41.476845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] RBAC: Authorizing `identity:delete_project(project_id=745e39d6522445af90a1704a724145c1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:41.479128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:41.480698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370f9e7-f093-47f2-a13e-44083f4ffdef admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:41.593979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745e39d6522445af90a1704a724145c1', 'request_id': 'req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:41.610098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745e39d6522445af90a1704a724145c1', 'request_id': 'req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:41.627748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370f9e7-f093-47f2-a13e-44083f4ffdef admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:41.631030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745e39d6522445af90a1704a724145c1', 'request_id': 'req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:41.656164 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] The token cache is being invalidate because project 745e39d6522445af90a1704a724145c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:13:41.656888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:41.659128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4047ba9e-8dfe-4ed8-a5f2-5d8fccda789c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:41.663586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 850/1690] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:13:41 2022] DELETE /identity/v3/projects/745e39d6522445af90a1704a724145c1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:41.668869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8755a-4c0f-43ad-9a88-b29eb07ceea6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:41.669531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8755a-4c0f-43ad-9a88-b29eb07ceea6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:41.670009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8755a-4c0f-43ad-9a88-b29eb07ceea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:41.709004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-77b8755a-4c0f-43ad-9a88-b29eb07ceea6 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:41.713482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-77b8755a-4c0f-43ad-9a88-b29eb07ceea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:41.778406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5552d6-c62c-44f9-981d-3fb972c4b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:41.781366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5552d6-c62c-44f9-981d-3fb972c4b6df admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:41.782373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5552d6-c62c-44f9-981d-3fb972c4b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:41.784697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5552d6-c62c-44f9-981d-3fb972c4b6df admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:41.789721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5552d6-c62c-44f9-981d-3fb972c4b6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:41.795464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5552d6-c62c-44f9-981d-3fb972c4b6df admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:41.858913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:41.867402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 841/1691] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:41 2022] POST /identity/v3/users => generated 297 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:41.875304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5552d6-c62c-44f9-981d-3fb972c4b6df admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:41.884270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2f5552d6-c62c-44f9-981d-3fb972c4b6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:41.908805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:41.930647 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5552d6-c62c-44f9-981d-3fb972c4b6df admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:41.941443 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 851/1692] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:41.951448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8ad3-eb5d-4d7a-be7d-5f09dbdae483 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:41.952247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8ad3-eb5d-4d7a-be7d-5f09dbdae483 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:41.953373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8ad3-eb5d-4d7a-be7d-5f09dbdae483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:41.954235 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572b32-9c4e-495c-adc6-95542468a2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:41.955861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572b32-9c4e-495c-adc6-95542468a2dd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:41.956261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572b32-9c4e-495c-adc6-95542468a2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:41.957889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572b32-9c4e-495c-adc6-95542468a2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:41.960845 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99572b32-9c4e-495c-adc6-95542468a2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:41.965204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99572b32-9c4e-495c-adc6-95542468a2dd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:42.000499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 842/1693] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:42.006254 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572b32-9c4e-495c-adc6-95542468a2dd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:42.016575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d3bf8ad3-eb5d-4d7a-be7d-5f09dbdae483 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:42.019539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d3bf8ad3-eb5d-4d7a-be7d-5f09dbdae483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:42.036247 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572b32-9c4e-495c-adc6-95542468a2dd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:42.044193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 852/1694] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:42.052626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8ad3-eb5d-4d7a-be7d-5f09dbdae483 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:42.057845 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f19e1a-9ecd-4dbf-bbf8-d1e855eb57b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:42.059482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f19e1a-9ecd-4dbf-bbf8-d1e855eb57b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:42.060482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f19e1a-9ecd-4dbf-bbf8-d1e855eb57b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:42.061002 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f19e1a-9ecd-4dbf-bbf8-d1e855eb57b9 admin admin] PATH_INFO: `/v3/projects/c8b8162c5825479699c93e7c89379f69/users/056493a0af32445a8cde285a18613712/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:42.082144 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8ad3-eb5d-4d7a-be7d-5f09dbdae483 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:42.095279 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e63d7-f26d-490c-a4ac-9c3ac54ddfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:42.096717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e63d7-f26d-490c-a4ac-9c3ac54ddfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:42.098382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e63d7-f26d-490c-a4ac-9c3ac54ddfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:42.099776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e63d7-f26d-490c-a4ac-9c3ac54ddfd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:42.100803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e63d7-f26d-490c-a4ac-9c3ac54ddfd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:42.102071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e63d7-f26d-490c-a4ac-9c3ac54ddfd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:42.104705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e63d7-f26d-490c-a4ac-9c3ac54ddfd1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:42.107024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f19e1a-9ecd-4dbf-bbf8-d1e855eb57b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b8162c5825479699c93e7c89379f69, user_id=056493a0af32445a8cde285a18613712, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:42.127253 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f19e1a-9ecd-4dbf-bbf8-d1e855eb57b9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:42.143061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 853/1695] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:42.155645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e63d7-f26d-490c-a4ac-9c3ac54ddfd1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:42.161697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 843/1696] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:42 2022] PUT /identity/v3/projects/c8b8162c5825479699c93e7c89379f69/users/056493a0af32445a8cde285a18613712/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:42.166553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f19e1a-9ecd-4dbf-bbf8-d1e855eb57b9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:42.190441 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e63d7-f26d-490c-a4ac-9c3ac54ddfd1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:42.358220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f19e1a-9ecd-4dbf-bbf8-d1e855eb57b9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:42.361120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179e2e8-869a-4744-86ab-a1879a27b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:42.361969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179e2e8-869a-4744-86ab-a1879a27b6cc admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:42.362810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179e2e8-869a-4744-86ab-a1879a27b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:42.363817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179e2e8-869a-4744-86ab-a1879a27b6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:42.366584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179e2e8-869a-4744-86ab-a1879a27b6cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:42.367485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef3066-a883-4626-ad71-948a24b22f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:42.370016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef3066-a883-4626-ad71-948a24b22f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:42.370397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef3066-a883-4626-ad71-948a24b22f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:42.371022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179e2e8-869a-4744-86ab-a1879a27b6cc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:42.371390 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef3066-a883-4626-ad71-948a24b22f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:42.374093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef3066-a883-4626-ad71-948a24b22f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:42.388071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef3066-a883-4626-ad71-948a24b22f33 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:42.429577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 844/1697] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:42.437659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef3066-a883-4626-ad71-948a24b22f33 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:42.445445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 854/1698] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:42 2022] POST /identity/v3/projects => generated 405 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:42.449674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179e2e8-869a-4744-86ab-a1879a27b6cc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:42.461735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef3066-a883-4626-ad71-948a24b22f33 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:42.652543 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada57a5f-cbfe-4ece-8e56-ceb86364649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:42.655863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada57a5f-cbfe-4ece-8e56-ceb86364649b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:42.657034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada57a5f-cbfe-4ece-8e56-ceb86364649b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:42.657925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada57a5f-cbfe-4ece-8e56-ceb86364649b admin admin] PATH_INFO: `/v3/projects/c8b8162c5825479699c93e7c89379f69/users/056493a0af32445a8cde285a18613712/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:42.662840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada57a5f-cbfe-4ece-8e56-ceb86364649b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b8162c5825479699c93e7c89379f69, user_id=056493a0af32445a8cde285a18613712, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:42.680705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179e2e8-869a-4744-86ab-a1879a27b6cc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:42.683196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada57a5f-cbfe-4ece-8e56-ceb86364649b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:42.698092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b8668-f8db-4a5e-b6dc-fd6647de4273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:42.698725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b8668-f8db-4a5e-b6dc-fd6647de4273 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:42.699245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b8668-f8db-4a5e-b6dc-fd6647de4273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:42.699523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b8668-f8db-4a5e-b6dc-fd6647de4273 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:42.701379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 845/1699] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:42 2022] PUT /identity/v3/projects/c8b8162c5825479699c93e7c89379f69/users/056493a0af32445a8cde285a18613712/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:42.712541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b8668-f8db-4a5e-b6dc-fd6647de4273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:42.712541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b8668-f8db-4a5e-b6dc-fd6647de4273 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:42.714572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e4ea-2a11-495c-9d6d-b837dfd4551a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:42.714965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e4ea-2a11-495c-9d6d-b837dfd4551a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:42.715349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e4ea-2a11-495c-9d6d-b837dfd4551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:42.753446 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 855/1700] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:42 2022] POST /identity/v3/users => generated 303 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:42.759365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b8668-f8db-4a5e-b6dc-fd6647de4273 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:42.778626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1075e4ea-2a11-495c-9d6d-b837dfd4551a None None] MFA Rules not processed for user `056493a0af32445a8cde285a18613712`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:42.780574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1075e4ea-2a11-495c-9d6d-b837dfd4551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:42.788914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b8668-f8db-4a5e-b6dc-fd6647de4273 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:42.942544 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:42.987089 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:43.038634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e8bd1-1317-4548-bb40-c1d4b015acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:43.042010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e8bd1-1317-4548-bb40-c1d4b015acac admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:43.042465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e8bd1-1317-4548-bb40-c1d4b015acac admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:43.042913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e8bd1-1317-4548-bb40-c1d4b015acac admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:43.046424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e8bd1-1317-4548-bb40-c1d4b015acac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:43.050489 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e8bd1-1317-4548-bb40-c1d4b015acac admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:43.081817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 846/1701] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:13:43.083385 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075e4ea-2a11-495c-9d6d-b837dfd4551a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:43.084676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 856/1702] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:43.087028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1075e4ea-2a11-495c-9d6d-b837dfd4551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:43.087239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e8bd1-1317-4548-bb40-c1d4b015acac admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:43.108619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e8bd1-1317-4548-bb40-c1d4b015acac admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:43.118146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075e4ea-2a11-495c-9d6d-b837dfd4551a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:43.123572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31a83d-e86d-40b7-ad38-9df755f60f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:43.124324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a83d-e86d-40b7-ad38-9df755f60f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:43.124610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a83d-e86d-40b7-ad38-9df755f60f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:43.127271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a83d-e86d-40b7-ad38-9df755f60f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:43.131837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31a83d-e86d-40b7-ad38-9df755f60f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:43.133561 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31a83d-e86d-40b7-ad38-9df755f60f97 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:43.150821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:43.151843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:43.152235 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:43.152615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] PATH_INFO: `/v3/projects/d8b4f20938554072a030b2d5e911e95c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:43.154535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b4f20938554072a030b2d5e911e95c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:43.156883 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:43.160706 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 857/1703] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:43.161456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31a83d-e86d-40b7-ad38-9df755f60f97 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:43.177733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c31a83d-e86d-40b7-ad38-9df755f60f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:43.260945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b4f20938554072a030b2d5e911e95c', 'request_id': 'req-23b474ad-bfca-4012-ba11-edd72d96edff'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:43.275250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b4f20938554072a030b2d5e911e95c', 'request_id': 'req-23b474ad-bfca-4012-ba11-edd72d96edff'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:43.283968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b4f20938554072a030b2d5e911e95c', 'request_id': 'req-23b474ad-bfca-4012-ba11-edd72d96edff'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:43.302680 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] The token cache is being invalidate because project d8b4f20938554072a030b2d5e911e95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:13:43.303254 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:43.311255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:43.314829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 847/1704] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:13:43 2022] DELETE /identity/v3/projects/d8b4f20938554072a030b2d5e911e95c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:43.320242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:43.327017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:43.370815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31a83d-e86d-40b7-ad38-9df755f60f97 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:43.471777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3454af-a90e-46d4-8f39-a87201c8252f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:43.474167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3454af-a90e-46d4-8f39-a87201c8252f service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:43.477001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3454af-a90e-46d4-8f39-a87201c8252f service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:43.478484 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3454af-a90e-46d4-8f39-a87201c8252f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:43.483311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ee3454af-a90e-46d4-8f39-a87201c8252f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:43.494432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b474ad-bfca-4012-ba11-edd72d96edff admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:43.501284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef406e1-e7c0-4869-b134-5f8457d350c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:43.504727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef406e1-e7c0-4869-b134-5f8457d350c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:43.505967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef406e1-e7c0-4869-b134-5f8457d350c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:43.506532 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef406e1-e7c0-4869-b134-5f8457d350c6 admin admin] PATH_INFO: `/v3/projects/e2b6448e54ae48229b39c3cc88748899/users/99095f2cc00249d4bf7a0fe118b8cbc1/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:43.536876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef406e1-e7c0-4869-b134-5f8457d350c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b6448e54ae48229b39c3cc88748899, user_id=99095f2cc00249d4bf7a0fe118b8cbc1, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:43.545511 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef406e1-e7c0-4869-b134-5f8457d350c6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:43.589960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 848/1705] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:43 2022] PUT /identity/v3/projects/e2b6448e54ae48229b39c3cc88748899/users/99095f2cc00249d4bf7a0fe118b8cbc1/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:43.592339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef406e1-e7c0-4869-b134-5f8457d350c6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:43.596117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ef406e1-e7c0-4869-b134-5f8457d350c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:43.668811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3454af-a90e-46d4-8f39-a87201c8252f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:43.681543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3454af-a90e-46d4-8f39-a87201c8252f service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:43.758657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 858/1706] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:43.764121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e65ab2-196f-4b22-91ae-edb854cd3ed8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:43.764523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e65ab2-196f-4b22-91ae-edb854cd3ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:43.764910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e65ab2-196f-4b22-91ae-edb854cd3ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:43.807146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:43.868263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-63e65ab2-196f-4b22-91ae-edb854cd3ed8 None None] MFA Rules not processed for user `99095f2cc00249d4bf7a0fe118b8cbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:43.877303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-63e65ab2-196f-4b22-91ae-edb854cd3ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:43.878586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef406e1-e7c0-4869-b134-5f8457d350c6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:43.898141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:43.904462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:43.904905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:43.906224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] PATH_INFO: `/v3/users/6d006e097cba40b7ab06c149a86f18e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:43.910902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d006e097cba40b7ab06c149a86f18e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:43.920630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:43.944705 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:44.065709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d006e097cba40b7ab06c149a86f18e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:44.110982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d006e097cba40b7ab06c149a86f18e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:44.115243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 859/1707] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:44.117042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08015e8-3ed4-4cfe-86d7-feb865b5e313 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:44.117559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08015e8-3ed4-4cfe-86d7-feb865b5e313 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:44.118121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08015e8-3ed4-4cfe-86d7-feb865b5e313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:44.128793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d006e097cba40b7ab06c149a86f18e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:44.152107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d006e097cba40b7ab06c149a86f18e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:44.156898 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d006e097cba40b7ab06c149a86f18e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:44.181566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 849/1708] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:43 2022] DELETE /identity/v3/users/6d006e097cba40b7ab06c149a86f18e7 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:44.181566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:44.188228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:44.196609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a08015e8-3ed4-4cfe-86d7-feb865b5e313 None None] MFA Rules not processed for user `ee7a49315d634014bc8e89b33c6355d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:44.198752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a08015e8-3ed4-4cfe-86d7-feb865b5e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:44.335584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e13b-f6b2-4ea0-815c-d971bb7a83ad admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:44.347326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a204e-b69c-41db-bf23-3550188fcae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:44.348368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a204e-b69c-41db-bf23-3550188fcae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:44.350374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a204e-b69c-41db-bf23-3550188fcae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:44.350796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a204e-b69c-41db-bf23-3550188fcae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:44.355638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-972a204e-b69c-41db-bf23-3550188fcae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:44.376765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 860/1709] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:44.377818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08015e8-3ed4-4cfe-86d7-feb865b5e313 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:44.387430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a08015e8-3ed4-4cfe-86d7-feb865b5e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:44.476953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a204e-b69c-41db-bf23-3550188fcae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:44.481365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a204e-b69c-41db-bf23-3550188fcae8 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:44.510750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 850/1710] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:44.515051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb033ff-3ef3-4d8c-85ae-f94543874373 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:44.515337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb033ff-3ef3-4d8c-85ae-f94543874373 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:44.515619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb033ff-3ef3-4d8c-85ae-f94543874373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:44.563535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8fb033ff-3ef3-4d8c-85ae-f94543874373 None None] MFA Rules not processed for user `ee7a49315d634014bc8e89b33c6355d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:44.565061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08015e8-3ed4-4cfe-86d7-feb865b5e313 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:44.566304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8fb033ff-3ef3-4d8c-85ae-f94543874373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:44.577712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507714f-a80c-44a6-90be-f6c645b72a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:44.578584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507714f-a80c-44a6-90be-f6c645b72a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:44.578878 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507714f-a80c-44a6-90be-f6c645b72a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:44.579686 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507714f-a80c-44a6-90be-f6c645b72a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:44.580405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507714f-a80c-44a6-90be-f6c645b72a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:44.586690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 851/1711] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:44.592245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507714f-a80c-44a6-90be-f6c645b72a9d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:44.601567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb033ff-3ef3-4d8c-85ae-f94543874373 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:44.603879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8fb033ff-3ef3-4d8c-85ae-f94543874373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:44.642370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:44.665878 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 861/1712] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:44 2022] POST /identity/v3/projects => generated 403 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:44.670621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507714f-a80c-44a6-90be-f6c645b72a9d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:44.754442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:44.782493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb033ff-3ef3-4d8c-85ae-f94543874373 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:44.871971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507714f-a80c-44a6-90be-f6c645b72a9d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:44.887156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af8ef-e1be-4fa4-b640-6b66a68307f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:44.889806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af8ef-e1be-4fa4-b640-6b66a68307f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:44.891278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af8ef-e1be-4fa4-b640-6b66a68307f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:44.891715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af8ef-e1be-4fa4-b640-6b66a68307f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:44.893254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4af8ef-e1be-4fa4-b640-6b66a68307f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:44.896795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4af8ef-e1be-4fa4-b640-6b66a68307f0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:44.959168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 862/1713] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:44 2022] POST /identity/v3/users => generated 308 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:44.961594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af8ef-e1be-4fa4-b640-6b66a68307f0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:44.980778 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af8ef-e1be-4fa4-b640-6b66a68307f0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:44.989012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4959-e2d7-4278-ae63-1d5426720239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:44.990431 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4959-e2d7-4278-ae63-1d5426720239 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:44.990866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4959-e2d7-4278-ae63-1d5426720239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:44.991358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4959-e2d7-4278-ae63-1d5426720239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:44.992314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb4959-e2d7-4278-ae63-1d5426720239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:44.994300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb4959-e2d7-4278-ae63-1d5426720239 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:44.999804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b4fc6-b737-4a07-90ab-168bede09280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:45.000478 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b4fc6-b737-4a07-90ab-168bede09280 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:45.000772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b4fc6-b737-4a07-90ab-168bede09280 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:45.001056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b4fc6-b737-4a07-90ab-168bede09280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:45.015559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 863/1714] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:45.021259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4959-e2d7-4278-ae63-1d5426720239 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:45.041752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4959-e2d7-4278-ae63-1d5426720239 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:45.052059 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc512a-f21f-44f3-93f9-0fcc41c43df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:45.055073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc512a-f21f-44f3-93f9-0fcc41c43df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:45.055609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc512a-f21f-44f3-93f9-0fcc41c43df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:45.056287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc512a-f21f-44f3-93f9-0fcc41c43df9 admin admin] PATH_INFO: `/v3/projects/b652a7eb8e1b427f81de23f91c2c5fa9/users/352ba4165a554cb68228974e560d9c63/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:45.081871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc512a-f21f-44f3-93f9-0fcc41c43df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b652a7eb8e1b427f81de23f91c2c5fa9, user_id=352ba4165a554cb68228974e560d9c63, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:45.085347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc512a-f21f-44f3-93f9-0fcc41c43df9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:45.112573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 864/1715] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:45 2022] PUT /identity/v3/projects/b652a7eb8e1b427f81de23f91c2c5fa9/users/352ba4165a554cb68228974e560d9c63/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:45.114698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc512a-f21f-44f3-93f9-0fcc41c43df9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:45.127735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b4fc6-b737-4a07-90ab-168bede09280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:45.131333 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b4fc6-b737-4a07-90ab-168bede09280 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:45.158295 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 852/1716] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:13:45.293520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc512a-f21f-44f3-93f9-0fcc41c43df9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:45.305519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed166b5-8c5d-4220-8dea-eaa3652c3d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:45.305906 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed166b5-8c5d-4220-8dea-eaa3652c3d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:45.306191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed166b5-8c5d-4220-8dea-eaa3652c3d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:45.306477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed166b5-8c5d-4220-8dea-eaa3652c3d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:45.307223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed166b5-8c5d-4220-8dea-eaa3652c3d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:45.309559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed166b5-8c5d-4220-8dea-eaa3652c3d5d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:45.323004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 865/1717] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:45.328891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b4fc6-b737-4a07-90ab-168bede09280 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:45.343577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b4fc6-b737-4a07-90ab-168bede09280 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:45.358197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdd2e5-23e1-4854-a6b5-2006bef366af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:45.360628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdd2e5-23e1-4854-a6b5-2006bef366af admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:45.360918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdd2e5-23e1-4854-a6b5-2006bef366af admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:45.361202 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdd2e5-23e1-4854-a6b5-2006bef366af admin admin] PATH_INFO: `/v3/projects/b652a7eb8e1b427f81de23f91c2c5fa9/users/352ba4165a554cb68228974e560d9c63/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:45.365707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdd2e5-23e1-4854-a6b5-2006bef366af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b652a7eb8e1b427f81de23f91c2c5fa9, user_id=352ba4165a554cb68228974e560d9c63, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:45.373903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdd2e5-23e1-4854-a6b5-2006bef366af admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:45.405342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 853/1718] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:45 2022] PUT /identity/v3/projects/b652a7eb8e1b427f81de23f91c2c5fa9/users/352ba4165a554cb68228974e560d9c63/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:45.419994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44e94-5207-4c9a-909f-2f971acfc25d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:45.420479 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44e94-5207-4c9a-909f-2f971acfc25d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:45.420775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c44e94-5207-4c9a-909f-2f971acfc25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:45.495276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a3c44e94-5207-4c9a-909f-2f971acfc25d None None] MFA Rules not processed for user `352ba4165a554cb68228974e560d9c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:45.496846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3c44e94-5207-4c9a-909f-2f971acfc25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:45.546967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8d2a2-e61c-4256-86cc-590fea24f606 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:45.547063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8d2a2-e61c-4256-86cc-590fea24f606 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:45.547419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8d2a2-e61c-4256-86cc-590fea24f606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:45.622974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cba8d2a2-e61c-4256-86cc-590fea24f606 None None] MFA Rules not processed for user `f8b281f5fe3847fb8f744894b73e7b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:45.624234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cba8d2a2-e61c-4256-86cc-590fea24f606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:45.693105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 866/1719] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:45.695645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c44e94-5207-4c9a-909f-2f971acfc25d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:45.698415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:45.699857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3c44e94-5207-4c9a-909f-2f971acfc25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:45.727432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:45.830238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 854/1720] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:13:45.831544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8d2a2-e61c-4256-86cc-590fea24f606 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:45.879919 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c44e94-5207-4c9a-909f-2f971acfc25d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:45.893507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:45.896899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:45.897550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:45.899077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] PATH_INFO: `/v3/projects/81e206835e31469687389c1f3adc8502` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:45.902074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e206835e31469687389c1f3adc8502)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:45.905389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:45.955096 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8d2a2-e61c-4256-86cc-590fea24f606 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:45.966905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2600b-e0f4-4a30-90bf-e24eee61ec52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:45.968183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2600b-e0f4-4a30-90bf-e24eee61ec52 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:45.968183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2600b-e0f4-4a30-90bf-e24eee61ec52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:45.968434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2600b-e0f4-4a30-90bf-e24eee61ec52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:45.988455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2600b-e0f4-4a30-90bf-e24eee61ec52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:45.990687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2600b-e0f4-4a30-90bf-e24eee61ec52 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:46.019874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e206835e31469687389c1f3adc8502', 'request_id': 'req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.021414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 855/1721] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:46.025365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990104c-9456-496c-aa35-cb9c1da094c8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:46.025684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990104c-9456-496c-aa35-cb9c1da094c8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:46.025970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990104c-9456-496c-aa35-cb9c1da094c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:46.038980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e206835e31469687389c1f3adc8502', 'request_id': 'req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.056370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e206835e31469687389c1f3adc8502', 'request_id': 'req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.090757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0990104c-9456-496c-aa35-cb9c1da094c8 None None] MFA Rules not processed for user `f8b281f5fe3847fb8f744894b73e7b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:46.094628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0990104c-9456-496c-aa35-cb9c1da094c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:46.123132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] The token cache is being invalidate because project 81e206835e31469687389c1f3adc8502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:13:46.123914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.124897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9cd13c3-5328-4da5-90ec-5195c3d8c0a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.127543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 867/1722] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:13:45 2022] DELETE /identity/v3/projects/81e206835e31469687389c1f3adc8502 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:46.140191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807920-39ad-4daa-8d0c-d2648dc9af7a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:46.140791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807920-39ad-4daa-8d0c-d2648dc9af7a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:46.141346 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807920-39ad-4daa-8d0c-d2648dc9af7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:46.234456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5a807920-39ad-4daa-8d0c-d2648dc9af7a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:46.237714 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a807920-39ad-4daa-8d0c-d2648dc9af7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:46.318871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 856/1723] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:46.334185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990104c-9456-496c-aa35-cb9c1da094c8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:46.335182 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0990104c-9456-496c-aa35-cb9c1da094c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:46.531680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 868/1724] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:46.535606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a807920-39ad-4daa-8d0c-d2648dc9af7a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:46.555892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a807920-39ad-4daa-8d0c-d2648dc9af7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:46.594886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990104c-9456-496c-aa35-cb9c1da094c8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:46.602170 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4784b7-b632-4b26-94c8-ec193e573909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:46.603146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784b7-b632-4b26-94c8-ec193e573909 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:46.603305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784b7-b632-4b26-94c8-ec193e573909 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:46.603695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784b7-b632-4b26-94c8-ec193e573909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:46.608428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ff4784b7-b632-4b26-94c8-ec193e573909 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:46.625096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a807920-39ad-4daa-8d0c-d2648dc9af7a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:46.631802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4784b7-b632-4b26-94c8-ec193e573909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:46.635248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4784b7-b632-4b26-94c8-ec193e573909 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:46.647795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:46.648790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:46.649075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:46.649714 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] PATH_INFO: `/v3/users/99095f2cc00249d4bf7a0fe118b8cbc1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:46.658124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:46.659343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99095f2cc00249d4bf7a0fe118b8cbc1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:46.665370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:46.683796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 857/1725] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:13:46.685446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa5d82-9519-451b-9f60-93a488df4d08 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:46.686021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa5d82-9519-451b-9f60-93a488df4d08 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:46.686446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa5d82-9519-451b-9f60-93a488df4d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:46.758078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f5fa5d82-9519-451b-9f60-93a488df4d08 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:46.766860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f5fa5d82-9519-451b-9f60-93a488df4d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:46.779881 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:46.796693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 858/1726] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:46.799941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cf9e-5136-4c17-a19b-bc6aec7f9baf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:46.801395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cf9e-5136-4c17-a19b-bc6aec7f9baf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:46.803073 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cf9e-5136-4c17-a19b-bc6aec7f9baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:46.806716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99095f2cc00249d4bf7a0fe118b8cbc1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.844046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99095f2cc00249d4bf7a0fe118b8cbc1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.845745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8261cf9e-5136-4c17-a19b-bc6aec7f9baf None None] MFA Rules not processed for user `67ff3d88fac84118b43dbe17caad5241`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:46.848253 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8261cf9e-5136-4c17-a19b-bc6aec7f9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:46.863897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99095f2cc00249d4bf7a0fe118b8cbc1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.865951 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99095f2cc00249d4bf7a0fe118b8cbc1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.867696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99095f2cc00249d4bf7a0fe118b8cbc1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:46.904687 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 869/1727] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:46 2022] DELETE /identity/v3/users/99095f2cc00249d4bf7a0fe118b8cbc1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:46.908947 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:46.913373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:47.001113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 859/1728] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:47.001113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4c37-0b1f-428b-beab-1719196b787a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.001113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4c37-0b1f-428b-beab-1719196b787a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.001113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4c37-0b1f-428b-beab-1719196b787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.035595 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0e1b4c37-0b1f-428b-beab-1719196b787a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:47.041489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0e1b4c37-0b1f-428b-beab-1719196b787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:47.052203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6085cc-6b34-49ef-bd87-e62a65ec986d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:47.066027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 860/1729] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:47.068242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f3eac-e7bb-43d5-858e-351251b4a3d2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.069111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895671b-3a79-45ee-8241-052e12e86965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:47.070349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895671b-3a79-45ee-8241-052e12e86965 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.070810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f3eac-e7bb-43d5-858e-351251b4a3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.071069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895671b-3a79-45ee-8241-052e12e86965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.071759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895671b-3a79-45ee-8241-052e12e86965 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.072961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895671b-3a79-45ee-8241-052e12e86965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:47.073941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895671b-3a79-45ee-8241-052e12e86965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:47.076888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895671b-3a79-45ee-8241-052e12e86965 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:47.081391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f3eac-e7bb-43d5-858e-351251b4a3d2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.090691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 861/1730] 10.222.0.90 () {54 vars in 912 bytes} [Tue Jun 21 15:13:47 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:13:47.097075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94ee3-5804-432a-8585-5709e8b1c20f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.097299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94ee3-5804-432a-8585-5709e8b1c20f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.099936 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94ee3-5804-432a-8585-5709e8b1c20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.111053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 870/1731] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:47.112086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895671b-3a79-45ee-8241-052e12e86965 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:47.125251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895671b-3a79-45ee-8241-052e12e86965 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:47.130399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf2aca-1e0d-4d41-b300-d117c1c369d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:47.131350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf2aca-1e0d-4d41-b300-d117c1c369d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.132026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf2aca-1e0d-4d41-b300-d117c1c369d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.132026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf2aca-1e0d-4d41-b300-d117c1c369d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.132902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf2aca-1e0d-4d41-b300-d117c1c369d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:47.135355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf2aca-1e0d-4d41-b300-d117c1c369d8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:47.184766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 871/1732] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:47 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:47.186018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf2aca-1e0d-4d41-b300-d117c1c369d8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:47.190744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ffdf2aca-1e0d-4d41-b300-d117c1c369d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:47.267922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-44f94ee3-5804-432a-8585-5709e8b1c20f None None] MFA Rules not processed for user `08b3093a7415419cbb6d50701b09b7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:47.269510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-44f94ee3-5804-432a-8585-5709e8b1c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:47.343603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf2aca-1e0d-4d41-b300-d117c1c369d8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:47.357062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c3a96-e660-4adb-8a13-62352cb36f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:47.358097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3a96-e660-4adb-8a13-62352cb36f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.360166 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3a96-e660-4adb-8a13-62352cb36f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.360580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3a96-e660-4adb-8a13-62352cb36f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.440171 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 862/1733] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:13:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:47.442030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94ee3-5804-432a-8585-5709e8b1c20f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:47.459109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:47.512874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c3a96-e660-4adb-8a13-62352cb36f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:47.515299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c3a96-e660-4adb-8a13-62352cb36f22 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:47.533393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 872/1734] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:47.535090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c3a96-e660-4adb-8a13-62352cb36f22 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:47.536889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-633c3a96-e660-4adb-8a13-62352cb36f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:47.559931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c3a96-e660-4adb-8a13-62352cb36f22 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:47.566398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d803c7-4563-41a8-9d03-3892661bf00b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:47.567516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d803c7-4563-41a8-9d03-3892661bf00b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.567810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d803c7-4563-41a8-9d03-3892661bf00b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.568094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d803c7-4563-41a8-9d03-3892661bf00b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.578277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d803c7-4563-41a8-9d03-3892661bf00b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:47.582102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d803c7-4563-41a8-9d03-3892661bf00b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:47.609325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 873/1735] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:47.698975 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94ee3-5804-432a-8585-5709e8b1c20f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:47.714286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7c85-e5d1-44ed-8b03-33bc9cdc46a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:47.715159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7c85-e5d1-44ed-8b03-33bc9cdc46a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.715549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7c85-e5d1-44ed-8b03-33bc9cdc46a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.722708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7c85-e5d1-44ed-8b03-33bc9cdc46a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.725793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7c85-e5d1-44ed-8b03-33bc9cdc46a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:47.727908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7c85-e5d1-44ed-8b03-33bc9cdc46a2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:47.773612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 863/1736] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:47 2022] POST /identity/v3/users => generated 294 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:47.778132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d803c7-4563-41a8-9d03-3892661bf00b service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:47.811409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524a04-d21d-48cc-b65e-3fb83a7ea398 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.822453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524a04-d21d-48cc-b65e-3fb83a7ea398 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.823082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524a04-d21d-48cc-b65e-3fb83a7ea398 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.823776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d803c7-4563-41a8-9d03-3892661bf00b service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:47.825127 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 864/1737] 10.222.0.90 () {54 vars in 912 bytes} [Tue Jun 21 15:13:47 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:13:47.831604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf403-2a85-44ad-94db-def137399943 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.832028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf403-2a85-44ad-94db-def137399943 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.832457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cf403-2a85-44ad-94db-def137399943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.840835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd0aa-721a-40eb-bc94-ddfa48bfaef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:47.841539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd0aa-721a-40eb-bc94-ddfa48bfaef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.842607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd0aa-721a-40eb-bc94-ddfa48bfaef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:47.842977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd0aa-721a-40eb-bc94-ddfa48bfaef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:47.843722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd0aa-721a-40eb-bc94-ddfa48bfaef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:47.850644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd0aa-721a-40eb-bc94-ddfa48bfaef1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:47.873693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5a5cf403-2a85-44ad-94db-def137399943 None None] MFA Rules not processed for user `08b3093a7415419cbb6d50701b09b7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:47.875532 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5a5cf403-2a85-44ad-94db-def137399943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:47.883844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 874/1738] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:47.894607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 865/1739] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:13:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:47.904449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd0aa-721a-40eb-bc94-ddfa48bfaef1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:47.952301 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd0aa-721a-40eb-bc94-ddfa48bfaef1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:47.964893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf403-2a85-44ad-94db-def137399943 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:47.975685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cf403-2a85-44ad-94db-def137399943 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:47.978716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b07e6b-4ebb-40ec-a6a3-71e4681a1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:47.979419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b07e6b-4ebb-40ec-a6a3-71e4681a1787 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.992737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2417c9-4780-4b4d-af02-aa5c7db62bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:47.995173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2417c9-4780-4b4d-af02-aa5c7db62bbb service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:47.999557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b07e6b-4ebb-40ec-a6a3-71e4681a1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:48.000300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b07e6b-4ebb-40ec-a6a3-71e4681a1787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:48.000778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2417c9-4780-4b4d-af02-aa5c7db62bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:48.001118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b07e6b-4ebb-40ec-a6a3-71e4681a1787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:48.002802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b07e6b-4ebb-40ec-a6a3-71e4681a1787 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:48.004858 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2417c9-4780-4b4d-af02-aa5c7db62bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:48.039470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2417c9-4780-4b4d-af02-aa5c7db62bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:48.046957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2417c9-4780-4b4d-af02-aa5c7db62bbb service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:48.050597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 875/1740] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:48.057396 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b07e6b-4ebb-40ec-a6a3-71e4681a1787 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:48.068345 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:48.085745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 866/1741] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:13:48.086523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b07e6b-4ebb-40ec-a6a3-71e4681a1787 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:48.104628 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e031e7-ccd4-44f3-80d9-187308f3214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:48.105573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e031e7-ccd4-44f3-80d9-187308f3214a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:48.105863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e031e7-ccd4-44f3-80d9-187308f3214a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:48.106167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e031e7-ccd4-44f3-80d9-187308f3214a admin admin] PATH_INFO: `/v3/projects/b767156a2c494da586bc2830b9148bdc/users/c8d6ed71f89d4e60a1452a6c2a1c7530/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:48.171382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e031e7-ccd4-44f3-80d9-187308f3214a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b767156a2c494da586bc2830b9148bdc, user_id=c8d6ed71f89d4e60a1452a6c2a1c7530, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:48.178799 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e031e7-ccd4-44f3-80d9-187308f3214a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:48.238940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 876/1742] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:48 2022] PUT /identity/v3/projects/b767156a2c494da586bc2830b9148bdc/users/c8d6ed71f89d4e60a1452a6c2a1c7530/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:13:48.242234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c462a7-19f5-4934-84be-cfae20942442 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:48.242780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c462a7-19f5-4934-84be-cfae20942442 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:48.243584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c462a7-19f5-4934-84be-cfae20942442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:48.298368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-38c462a7-19f5-4934-84be-cfae20942442 None None] MFA Rules not processed for user `c8d6ed71f89d4e60a1452a6c2a1c7530`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:48.304760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38c462a7-19f5-4934-84be-cfae20942442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:48.521515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 867/1743] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:48.525597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e031e7-ccd4-44f3-80d9-187308f3214a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:48.676258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e031e7-ccd4-44f3-80d9-187308f3214a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:48.695151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46ed42-7fac-4c90-8bc4-4ec2fd336db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:48.695571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46ed42-7fac-4c90-8bc4-4ec2fd336db0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:48.695858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46ed42-7fac-4c90-8bc4-4ec2fd336db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:48.696215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46ed42-7fac-4c90-8bc4-4ec2fd336db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:48.696929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46ed42-7fac-4c90-8bc4-4ec2fd336db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:48.700227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46ed42-7fac-4c90-8bc4-4ec2fd336db0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:48.774902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 877/1744] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:48 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:48.775098 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c462a7-19f5-4934-84be-cfae20942442 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:48.795376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c462a7-19f5-4934-84be-cfae20942442 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:48.964677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46ed42-7fac-4c90-8bc4-4ec2fd336db0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:48.966560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9d46ed42-7fac-4c90-8bc4-4ec2fd336db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:48.986981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c211-bec2-476c-848e-727b0fa65297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:48.987877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c211-bec2-476c-848e-727b0fa65297 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:48.988443 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c211-bec2-476c-848e-727b0fa65297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:48.988825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c211-bec2-476c-848e-727b0fa65297 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:48.989847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c211-bec2-476c-848e-727b0fa65297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:48.993213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c211-bec2-476c-848e-727b0fa65297 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:49.033106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 868/1745] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:48 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:13:49.038235 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c211-bec2-476c-848e-727b0fa65297 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:49.068870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c211-bec2-476c-848e-727b0fa65297 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:49.079464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909f053-dbe8-4bfe-9a41-5ede2077185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:49.081615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909f053-dbe8-4bfe-9a41-5ede2077185c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:49.087226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909f053-dbe8-4bfe-9a41-5ede2077185c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:49.087698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909f053-dbe8-4bfe-9a41-5ede2077185c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:49.088606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909f053-dbe8-4bfe-9a41-5ede2077185c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:49.091483 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909f053-dbe8-4bfe-9a41-5ede2077185c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:49.137938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46ed42-7fac-4c90-8bc4-4ec2fd336db0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:49.139558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 869/1746] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:49.143697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909f053-dbe8-4bfe-9a41-5ede2077185c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:49.156327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:49.158308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909f053-dbe8-4bfe-9a41-5ede2077185c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:49.159415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:49.163998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:49.164296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] PATH_INFO: `/v3/projects/e2b6448e54ae48229b39c3cc88748899` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:49.166204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db805e8-aa64-49e5-95de-5f3a2fea1016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:49.167121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db805e8-aa64-49e5-95de-5f3a2fea1016 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:49.167625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db805e8-aa64-49e5-95de-5f3a2fea1016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:49.168045 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db805e8-aa64-49e5-95de-5f3a2fea1016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:49.168947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db805e8-aa64-49e5-95de-5f3a2fea1016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:49.169184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b6448e54ae48229b39c3cc88748899)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:49.171106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db805e8-aa64-49e5-95de-5f3a2fea1016 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:49.171222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:49.185628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 870/1747] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:49.189588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db805e8-aa64-49e5-95de-5f3a2fea1016 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:49.191302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:49.203764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db805e8-aa64-49e5-95de-5f3a2fea1016 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:49.209619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d384e4-3b37-40bb-9528-5ca3e0fdb00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:49.210534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d384e4-3b37-40bb-9528-5ca3e0fdb00e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:49.210804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d384e4-3b37-40bb-9528-5ca3e0fdb00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:49.211083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d384e4-3b37-40bb-9528-5ca3e0fdb00e admin admin] PATH_INFO: `/v3/projects/b2b433e200014040a07e9c398671c489/users/d485df1fe7344e5dbcc797c273b85304/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:49.228979 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d384e4-3b37-40bb-9528-5ca3e0fdb00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b433e200014040a07e9c398671c489, user_id=d485df1fe7344e5dbcc797c273b85304, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:49.231859 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d384e4-3b37-40bb-9528-5ca3e0fdb00e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:49.254740 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 871/1748] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:49 2022] PUT /identity/v3/projects/b2b433e200014040a07e9c398671c489/users/d485df1fe7344e5dbcc797c273b85304/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:13:49.267287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92328f93-7d62-4b5e-8afc-636e984e63c6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:49.268814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92328f93-7d62-4b5e-8afc-636e984e63c6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:49.269207 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92328f93-7d62-4b5e-8afc-636e984e63c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:49.335243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-92328f93-7d62-4b5e-8afc-636e984e63c6 None None] MFA Rules not processed for user `d485df1fe7344e5dbcc797c273b85304`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:49.337322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92328f93-7d62-4b5e-8afc-636e984e63c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:49.356598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b6448e54ae48229b39c3cc88748899', 'request_id': 'req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:49.370461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b6448e54ae48229b39c3cc88748899', 'request_id': 'req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:49.385522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:49.399996 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b6448e54ae48229b39c3cc88748899', 'request_id': 'req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:49.423103 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] The token cache is being invalidate because project e2b6448e54ae48229b39c3cc88748899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:13:49.423803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:49.426255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:49.435451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 878/1749] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:13:48 2022] DELETE /identity/v3/projects/e2b6448e54ae48229b39c3cc88748899 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:49.437423 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:49.440251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:49.517114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 872/1750] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:13:49.518747 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92328f93-7d62-4b5e-8afc-636e984e63c6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:49.528641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92328f93-7d62-4b5e-8afc-636e984e63c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:49.758712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8e7c2-b32b-4b94-9ddc-21043894b99c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:49.780054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:49.781386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:49.781845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:49.782274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:49.799639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:49.817507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92328f93-7d62-4b5e-8afc-636e984e63c6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:49.833999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:49.835495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:49.835864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:49.836185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] PATH_INFO: `/v3/users/352ba4165a554cb68228974e560d9c63` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:49.838107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=352ba4165a554cb68228974e560d9c63)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:49.850251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:49.866498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:49.873026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:49.902709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 879/1751] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:49.904577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:49.908303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:50.003852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcbdb4-e475-405a-a706-d86e9ced5e53 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:50.037807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebda97-6726-4c0b-80cf-e1ca6dfaab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:50.044814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebda97-6726-4c0b-80cf-e1ca6dfaab0e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:50.045333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebda97-6726-4c0b-80cf-e1ca6dfaab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:50.046566 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebda97-6726-4c0b-80cf-e1ca6dfaab0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:50.049921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebda97-6726-4c0b-80cf-e1ca6dfaab0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:50.059536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebda97-6726-4c0b-80cf-e1ca6dfaab0e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:50.080935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352ba4165a554cb68228974e560d9c63'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:50.152264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352ba4165a554cb68228974e560d9c63'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:50.179654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352ba4165a554cb68228974e560d9c63'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:50.203625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352ba4165a554cb68228974e560d9c63'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:50.205569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352ba4165a554cb68228974e560d9c63'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:50.225852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 880/1752] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:49 2022] POST /identity/v3/projects => generated 387 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:50.229099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e269-b542-425f-92c5-a30608efd5ad None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:50.229396 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e269-b542-425f-92c5-a30608efd5ad None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:50.229692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e269-b542-425f-92c5-a30608efd5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:50.238387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 873/1753] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:49 2022] DELETE /identity/v3/users/352ba4165a554cb68228974e560d9c63 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:50.238387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:50.249513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:50.330453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6e15e269-b542-425f-92c5-a30608efd5ad None None] MFA Rules not processed for user `873694a34f1f40128a9c2eeaaa8424cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:50.331712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6e15e269-b542-425f-92c5-a30608efd5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:50.437754 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:50.520254 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3938c-650d-4d91-9dad-9bc1f17aaabe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:50.542192 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436c19f-c7fe-44b8-8e72-08ff41e9c848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:50.545953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c19f-c7fe-44b8-8e72-08ff41e9c848 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:50.548304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c19f-c7fe-44b8-8e72-08ff41e9c848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:50.549370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c19f-c7fe-44b8-8e72-08ff41e9c848 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:50.550914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436c19f-c7fe-44b8-8e72-08ff41e9c848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:50.556050 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:50.561610 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436c19f-c7fe-44b8-8e72-08ff41e9c848 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:50.632989 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 874/1754] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:50 2022] POST /identity/v3/users => generated 300 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:50.653131 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9154c-04bf-44f1-b414-a72159e28a79 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:50.653420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9154c-04bf-44f1-b414-a72159e28a79 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:50.653730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9154c-04bf-44f1-b414-a72159e28a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:50.686080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 881/1755] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:50.690723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e269-b542-425f-92c5-a30608efd5ad None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:50.740094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e269-b542-425f-92c5-a30608efd5ad None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:50.759367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16200-dc90-4b2c-bd50-70dad381d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:50.766860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16200-dc90-4b2c-bd50-70dad381d987 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:50.767108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16200-dc90-4b2c-bd50-70dad381d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:50.767404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16200-dc90-4b2c-bd50-70dad381d987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:50.772408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c16200-dc90-4b2c-bd50-70dad381d987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:50.778043 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c16200-dc90-4b2c-bd50-70dad381d987 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:50.819568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-43b9154c-04bf-44f1-b414-a72159e28a79 None None] MFA Rules not processed for user `d56ce8a772d7417eb4224f3e13cc0759`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:50.825984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-43b9154c-04bf-44f1-b414-a72159e28a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:50.838162 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 882/1756] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:50.840889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16200-dc90-4b2c-bd50-70dad381d987 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:50.881257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16200-dc90-4b2c-bd50-70dad381d987 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:50.935678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b57b6a-6260-45b2-a19e-f137fa63a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:50.941776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57b6a-6260-45b2-a19e-f137fa63a167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:50.942980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57b6a-6260-45b2-a19e-f137fa63a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:50.944404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57b6a-6260-45b2-a19e-f137fa63a167 admin admin] PATH_INFO: `/v3/projects/816f180b1e8c460e835dd7edf1831b6e/users/161c0d8031554817b483c6312a620b01/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:51.046777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b57b6a-6260-45b2-a19e-f137fa63a167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816f180b1e8c460e835dd7edf1831b6e, user_id=161c0d8031554817b483c6312a620b01, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:51.087817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b57b6a-6260-45b2-a19e-f137fa63a167 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:51.103013 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 875/1757] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:51.105891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9154c-04bf-44f1-b414-a72159e28a79 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:51.108137 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-43b9154c-04bf-44f1-b414-a72159e28a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:51.175132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 883/1758] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:50 2022] PUT /identity/v3/projects/816f180b1e8c460e835dd7edf1831b6e/users/161c0d8031554817b483c6312a620b01/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:51.193067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c8a0-a519-4bf6-bc38-f3f7ed7de55a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:51.193600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c8a0-a519-4bf6-bc38-f3f7ed7de55a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:51.198025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8c8a0-a519-4bf6-bc38-f3f7ed7de55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:51.260086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c1b8c8a0-a519-4bf6-bc38-f3f7ed7de55a None None] MFA Rules not processed for user `ee7a49315d634014bc8e89b33c6355d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:51.266639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c1b8c8a0-a519-4bf6-bc38-f3f7ed7de55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:51.356875 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9154c-04bf-44f1-b414-a72159e28a79 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:51.559733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 884/1759] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:51.568185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c8a0-a519-4bf6-bc38-f3f7ed7de55a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:51.610812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:51.686615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8d4d-121b-4dc2-9f3a-76a8bc4e5376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:51.691292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8d4d-121b-4dc2-9f3a-76a8bc4e5376 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:51.691710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8d4d-121b-4dc2-9f3a-76a8bc4e5376 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:51.694460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8d4d-121b-4dc2-9f3a-76a8bc4e5376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:51.834892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8c8a0-a519-4bf6-bc38-f3f7ed7de55a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:51.847759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3f1d3-c0d0-4df5-9a9b-2c575956d8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:51.851784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f1d3-c0d0-4df5-9a9b-2c575956d8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:51.853711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f1d3-c0d0-4df5-9a9b-2c575956d8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:51.854140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f1d3-c0d0-4df5-9a9b-2c575956d8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:51.856563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3f1d3-c0d0-4df5-9a9b-2c575956d8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:51.860790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3f1d3-c0d0-4df5-9a9b-2c575956d8cc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:51.864277 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8d4d-121b-4dc2-9f3a-76a8bc4e5376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:51.867057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8d4d-121b-4dc2-9f3a-76a8bc4e5376 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:51.897496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 876/1761] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:51.897710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 885/1761] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:51.898853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3f1d3-c0d0-4df5-9a9b-2c575956d8cc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:51.904923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aae3f1d3-c0d0-4df5-9a9b-2c575956d8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:51.913924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8d4d-121b-4dc2-9f3a-76a8bc4e5376 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:51.919521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-157f8d4d-121b-4dc2-9f3a-76a8bc4e5376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:51.976053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3f1d3-c0d0-4df5-9a9b-2c575956d8cc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:51.986399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8d4d-121b-4dc2-9f3a-76a8bc4e5376 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:52.003637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95492fc-d7ed-425f-a4d6-b61ccd342317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:52.004327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95492fc-d7ed-425f-a4d6-b61ccd342317 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:52.004692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95492fc-d7ed-425f-a4d6-b61ccd342317 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:52.005035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95492fc-d7ed-425f-a4d6-b61ccd342317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:52.009628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:52.012024 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:52.016540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:52.017259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] PATH_INFO: `/v3/projects/b652a7eb8e1b427f81de23f91c2c5fa9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:52.020719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b652a7eb8e1b427f81de23f91c2c5fa9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:52.034371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:52.181631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:52.206148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b652a7eb8e1b427f81de23f91c2c5fa9', 'request_id': 'req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:52.213629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95492fc-d7ed-425f-a4d6-b61ccd342317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:52.215549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95492fc-d7ed-425f-a4d6-b61ccd342317 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:52.239053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b652a7eb8e1b427f81de23f91c2c5fa9', 'request_id': 'req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:52.240895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 886/1762] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:52.242018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95492fc-d7ed-425f-a4d6-b61ccd342317 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:52.269014 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95492fc-d7ed-425f-a4d6-b61ccd342317 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:52.274742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b652a7eb8e1b427f81de23f91c2c5fa9', 'request_id': 'req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:52.311562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] The token cache is being invalidate because project b652a7eb8e1b427f81de23f91c2c5fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:13:52.312235 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:52.314057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b510944f-a6a8-4efc-8f79-e6b685fbd7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:52.319444 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 877/1763] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:13:51 2022] DELETE /identity/v3/projects/b652a7eb8e1b427f81de23f91c2c5fa9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:52.346695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e739c-2b79-44bd-a983-24aaff129f4f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:52.346958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e739c-2b79-44bd-a983-24aaff129f4f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:52.347305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e739c-2b79-44bd-a983-24aaff129f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:52.412168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-401e739c-2b79-44bd-a983-24aaff129f4f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:52.415824 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-401e739c-2b79-44bd-a983-24aaff129f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:52.478408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4169721-e3dd-4775-b5b2-7c7e8e8b5162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:52.479574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169721-e3dd-4775-b5b2-7c7e8e8b5162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:52.479867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169721-e3dd-4775-b5b2-7c7e8e8b5162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:52.480149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4169721-e3dd-4775-b5b2-7c7e8e8b5162 admin admin] PATH_INFO: `/v3/projects/816f180b1e8c460e835dd7edf1831b6e/users/161c0d8031554817b483c6312a620b01/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:52.483908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4169721-e3dd-4775-b5b2-7c7e8e8b5162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816f180b1e8c460e835dd7edf1831b6e, user_id=161c0d8031554817b483c6312a620b01, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:52.487998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4169721-e3dd-4775-b5b2-7c7e8e8b5162 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:52.501733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 887/1764] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:52 2022] PUT /identity/v3/projects/816f180b1e8c460e835dd7edf1831b6e/users/161c0d8031554817b483c6312a620b01/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:52.524584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fac7a-e67f-45e6-a914-94c91137b29e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:52.524881 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fac7a-e67f-45e6-a914-94c91137b29e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:52.530503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fac7a-e67f-45e6-a914-94c91137b29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:52.589208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fa3fac7a-e67f-45e6-a914-94c91137b29e None None] MFA Rules not processed for user `161c0d8031554817b483c6312a620b01`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:52.590865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fa3fac7a-e67f-45e6-a914-94c91137b29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:52.597940 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 878/1765] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:52.606287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8ded-326d-4206-b27a-17457fc1daa9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:52.606871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8ded-326d-4206-b27a-17457fc1daa9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:52.607371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8ded-326d-4206-b27a-17457fc1daa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:52.642498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bb3f8ded-326d-4206-b27a-17457fc1daa9 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:52.646173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bb3f8ded-326d-4206-b27a-17457fc1daa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:52.682585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:52.753221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 888/1766] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:52.762887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fac7a-e67f-45e6-a914-94c91137b29e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:52.766856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fa3fac7a-e67f-45e6-a914-94c91137b29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:52.809780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 879/1767] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:13:52.814359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f8ded-326d-4206-b27a-17457fc1daa9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:52.836533 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f8ded-326d-4206-b27a-17457fc1daa9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:52.850676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354d52-7f5a-444f-b6e1-d654ae71265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:52.851485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354d52-7f5a-444f-b6e1-d654ae71265a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:52.851631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354d52-7f5a-444f-b6e1-d654ae71265a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:52.851922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354d52-7f5a-444f-b6e1-d654ae71265a admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:52.852646 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354d52-7f5a-444f-b6e1-d654ae71265a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:13:52.852952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354d52-7f5a-444f-b6e1-d654ae71265a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:52.858086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354d52-7f5a-444f-b6e1-d654ae71265a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:52.890619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 880/1768] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:13:52.894891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354d52-7f5a-444f-b6e1-d654ae71265a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:52.910939 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fac7a-e67f-45e6-a914-94c91137b29e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:52.915510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354d52-7f5a-444f-b6e1-d654ae71265a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:52.918498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607775df-e10d-42b5-9708-f7fea27f59d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:52.920192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607775df-e10d-42b5-9708-f7fea27f59d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:52.921042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607775df-e10d-42b5-9708-f7fea27f59d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:52.921335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607775df-e10d-42b5-9708-f7fea27f59d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:52.936710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607775df-e10d-42b5-9708-f7fea27f59d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:52.938953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607775df-e10d-42b5-9708-f7fea27f59d9 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:52.949521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233610fe-0e93-44f4-8215-d0758077b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:52.950258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233610fe-0e93-44f4-8215-d0758077b20a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:52.950549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233610fe-0e93-44f4-8215-d0758077b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:52.950830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233610fe-0e93-44f4-8215-d0758077b20a admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:52.952074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233610fe-0e93-44f4-8215-d0758077b20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:52.956239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233610fe-0e93-44f4-8215-d0758077b20a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:52.968046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 889/1769] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:53.027526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607775df-e10d-42b5-9708-f7fea27f59d9 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:53.038269 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 881/1770] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:52 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:53.045352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607775df-e10d-42b5-9708-f7fea27f59d9 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:53.092675 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:53.188036 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f3578-88d8-42bc-a3b5-63bdf7e7a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:53.189362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3578-88d8-42bc-a3b5-63bdf7e7a44b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:53.189884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3578-88d8-42bc-a3b5-63bdf7e7a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:53.190372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3578-88d8-42bc-a3b5-63bdf7e7a44b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:53.191247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f3578-88d8-42bc-a3b5-63bdf7e7a44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:53.194586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f3578-88d8-42bc-a3b5-63bdf7e7a44b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:53.229436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 890/1771] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:53 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:13:53.232615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233610fe-0e93-44f4-8215-d0758077b20a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:53.254065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233610fe-0e93-44f4-8215-d0758077b20a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:53.285958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a32a3-09ac-49ad-b2b1-ca9aec375034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:53.287254 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a32a3-09ac-49ad-b2b1-ca9aec375034 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:53.290157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a32a3-09ac-49ad-b2b1-ca9aec375034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:53.290611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a32a3-09ac-49ad-b2b1-ca9aec375034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:53.296210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a32a3-09ac-49ad-b2b1-ca9aec375034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:53.301713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a32a3-09ac-49ad-b2b1-ca9aec375034 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:53.332920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 882/1772] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:53.336717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f3578-88d8-42bc-a3b5-63bdf7e7a44b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:53.353591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f3578-88d8-42bc-a3b5-63bdf7e7a44b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:53.370546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4b28-da89-43e5-a31b-1ab5181d5c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:53.371505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4b28-da89-43e5-a31b-1ab5181d5c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:53.371848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4b28-da89-43e5-a31b-1ab5181d5c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:53.372134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4b28-da89-43e5-a31b-1ab5181d5c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:53.372949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4b28-da89-43e5-a31b-1ab5181d5c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:53.378284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4b28-da89-43e5-a31b-1ab5181d5c24 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:53.412688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 891/1773] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:53.414784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a32a3-09ac-49ad-b2b1-ca9aec375034 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:53.432132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a32a3-09ac-49ad-b2b1-ca9aec375034 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:53.445200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f206e6-b7ac-400b-8bf4-648f62a59a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:53.446486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f206e6-b7ac-400b-8bf4-648f62a59a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:53.453171 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f206e6-b7ac-400b-8bf4-648f62a59a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:53.453651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f206e6-b7ac-400b-8bf4-648f62a59a6d admin admin] PATH_INFO: `/v3/projects/1639b5346bf941d6b3b36b0f43d412ee/users/3233901689f640f583364111a19fd17d/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:53.525282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f206e6-b7ac-400b-8bf4-648f62a59a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1639b5346bf941d6b3b36b0f43d412ee, user_id=3233901689f640f583364111a19fd17d, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:53.528406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f206e6-b7ac-400b-8bf4-648f62a59a6d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:53.553449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 883/1774] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:53 2022] PUT /identity/v3/projects/1639b5346bf941d6b3b36b0f43d412ee/users/3233901689f640f583364111a19fd17d/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:53.565437 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aec73-d584-4342-b456-edab8009d86c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:53.565783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aec73-d584-4342-b456-edab8009d86c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:53.566108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aec73-d584-4342-b456-edab8009d86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:53.634112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ca0aec73-d584-4342-b456-edab8009d86c None None] MFA Rules not processed for user `3233901689f640f583364111a19fd17d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:53.635370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ca0aec73-d584-4342-b456-edab8009d86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:53.841989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 892/1775] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:53.846359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f206e6-b7ac-400b-8bf4-648f62a59a6d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:53.942759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f206e6-b7ac-400b-8bf4-648f62a59a6d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:53.949658 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee554608-891c-4b28-86dc-bbd4c4899062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:53.950602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee554608-891c-4b28-86dc-bbd4c4899062 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:53.951019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee554608-891c-4b28-86dc-bbd4c4899062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:53.951536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee554608-891c-4b28-86dc-bbd4c4899062 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:53.953056 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee554608-891c-4b28-86dc-bbd4c4899062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:53.959433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee554608-891c-4b28-86dc-bbd4c4899062 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:54.037525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 884/1776] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:13:53 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:54.040092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aec73-d584-4342-b456-edab8009d86c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:54.054510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aec73-d584-4342-b456-edab8009d86c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:54.209763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0ee08-7456-44e5-abf2-b9e48e0794fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:54.211902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0ee08-7456-44e5-abf2-b9e48e0794fa admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:54.214142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0ee08-7456-44e5-abf2-b9e48e0794fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:54.214500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0ee08-7456-44e5-abf2-b9e48e0794fa admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:54.217261 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0ee08-7456-44e5-abf2-b9e48e0794fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:54.219304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee554608-891c-4b28-86dc-bbd4c4899062 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:54.223227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0ee08-7456-44e5-abf2-b9e48e0794fa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:54.287073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 893/1777] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:13:54 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:13:54.291931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0ee08-7456-44e5-abf2-b9e48e0794fa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:54.299977 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:54.339563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0ee08-7456-44e5-abf2-b9e48e0794fa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:54.355843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecfb49-27fe-41ed-ac90-803c0081a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:54.358393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecfb49-27fe-41ed-ac90-803c0081a436 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:54.358825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecfb49-27fe-41ed-ac90-803c0081a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:54.359439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecfb49-27fe-41ed-ac90-803c0081a436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:54.361179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecfb49-27fe-41ed-ac90-803c0081a436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:54.363640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecfb49-27fe-41ed-ac90-803c0081a436 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:54.375994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee554608-891c-4b28-86dc-bbd4c4899062 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:54.380474 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ac277-9b27-4b26-8835-e41451c86437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:54.381161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ac277-9b27-4b26-8835-e41451c86437 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:54.381284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:54.381533 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ac277-9b27-4b26-8835-e41451c86437 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:54.381743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ac277-9b27-4b26-8835-e41451c86437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:54.383667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f81ac277-9b27-4b26-8835-e41451c86437 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:54.401463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 894/1778] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:54.402825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecfb49-27fe-41ed-ac90-803c0081a436 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:54.425069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecfb49-27fe-41ed-ac90-803c0081a436 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:54.438375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2f522-8da4-4de5-b9c1-386814e32011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:54.439731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2f522-8da4-4de5-b9c1-386814e32011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:54.442781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2f522-8da4-4de5-b9c1-386814e32011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:54.443159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2f522-8da4-4de5-b9c1-386814e32011 admin admin] PATH_INFO: `/v3/projects/8e1bfbedd757424f9722949b897032e2/users/3efc60022a1944cf86eae3da89309861/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:54.468855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2f522-8da4-4de5-b9c1-386814e32011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1bfbedd757424f9722949b897032e2, user_id=3efc60022a1944cf86eae3da89309861, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:54.471681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2f522-8da4-4de5-b9c1-386814e32011 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:54.498374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 895/1779] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:54 2022] PUT /identity/v3/projects/8e1bfbedd757424f9722949b897032e2/users/3efc60022a1944cf86eae3da89309861/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:54.504197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2f522-8da4-4de5-b9c1-386814e32011 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:54.637252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ac277-9b27-4b26-8835-e41451c86437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:54.642813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ac277-9b27-4b26-8835-e41451c86437 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:54.670007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 885/1780] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:54.748558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2f522-8da4-4de5-b9c1-386814e32011 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:54.768426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5656282-26a8-44d0-94b7-b8653396cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:54.769132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5656282-26a8-44d0-94b7-b8653396cedd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:54.769417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5656282-26a8-44d0-94b7-b8653396cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:54.769774 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5656282-26a8-44d0-94b7-b8653396cedd admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:54.771076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5656282-26a8-44d0-94b7-b8653396cedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:54.783657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5656282-26a8-44d0-94b7-b8653396cedd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:54.818648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 896/1781] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:13:54.823865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ac277-9b27-4b26-8835-e41451c86437 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:54.843565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ac277-9b27-4b26-8835-e41451c86437 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:54.855982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440a6e-e633-4b3e-b5ca-ce1bfdd3934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:54.857841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440a6e-e633-4b3e-b5ca-ce1bfdd3934a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:54.865291 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440a6e-e633-4b3e-b5ca-ce1bfdd3934a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:54.865830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440a6e-e633-4b3e-b5ca-ce1bfdd3934a admin admin] PATH_INFO: `/v3/projects/8e1bfbedd757424f9722949b897032e2/users/3efc60022a1944cf86eae3da89309861/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:54.874360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2440a6e-e633-4b3e-b5ca-ce1bfdd3934a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1bfbedd757424f9722949b897032e2, user_id=3efc60022a1944cf86eae3da89309861, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:54.881147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2440a6e-e633-4b3e-b5ca-ce1bfdd3934a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:54.916698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 886/1782] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:13:54 2022] PUT /identity/v3/projects/8e1bfbedd757424f9722949b897032e2/users/3efc60022a1944cf86eae3da89309861/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:54.928144 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe8782-22a3-4c63-ba29-b6c6a563ad7c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:54.928445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe8782-22a3-4c63-ba29-b6c6a563ad7c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:54.928739 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe8782-22a3-4c63-ba29-b6c6a563ad7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:54.997150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-23fe8782-22a3-4c63-ba29-b6c6a563ad7c None None] MFA Rules not processed for user `3efc60022a1944cf86eae3da89309861`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:54.998444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-23fe8782-22a3-4c63-ba29-b6c6a563ad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:55.251742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 897/1783] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:55.259705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440a6e-e633-4b3e-b5ca-ce1bfdd3934a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:55.261462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e2440a6e-e633-4b3e-b5ca-ce1bfdd3934a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:55.439737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440a6e-e633-4b3e-b5ca-ce1bfdd3934a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:55.459384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4101f6-993a-49fb-b136-e10d2404c717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:55.459600 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4101f6-993a-49fb-b136-e10d2404c717 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:55.459957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4101f6-993a-49fb-b136-e10d2404c717 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:55.460350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4101f6-993a-49fb-b136-e10d2404c717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:55.517707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4101f6-993a-49fb-b136-e10d2404c717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:55.519203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4101f6-993a-49fb-b136-e10d2404c717 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:55.571866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 887/1784] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:55.633738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe8782-22a3-4c63-ba29-b6c6a563ad7c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:55.938057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:55.949948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe8782-22a3-4c63-ba29-b6c6a563ad7c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:55.971183 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:55.975538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:55.977013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:55.978160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] PATH_INFO: `/v3/users/3233901689f640f583364111a19fd17d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:55.984114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3233901689f640f583364111a19fd17d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:55.992272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:56.164957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3233901689f640f583364111a19fd17d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:56.231921 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3233901689f640f583364111a19fd17d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:56.258175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3233901689f640f583364111a19fd17d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:56.258953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3233901689f640f583364111a19fd17d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:56.261659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3233901689f640f583364111a19fd17d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:56.367127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 898/1785] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:55 2022] DELETE /identity/v3/users/3233901689f640f583364111a19fd17d => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:56.372061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47224-7718-4130-bd3e-b73f803cd783 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:56.372590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47224-7718-4130-bd3e-b73f803cd783 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:56.373032 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47224-7718-4130-bd3e-b73f803cd783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:56.421963 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8fb47224-7718-4130-bd3e-b73f803cd783 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:56.423208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8fb47224-7718-4130-bd3e-b73f803cd783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:56.581944 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 888/1786] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:56.629460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:56.632077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:56.832205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22a827-7869-4e04-8db0-21d8adf246f8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:56.837584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a19f05-c296-42d5-9d34-970f66bc7912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:56.838258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a19f05-c296-42d5-9d34-970f66bc7912 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:56.838544 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a19f05-c296-42d5-9d34-970f66bc7912 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:56.838821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a19f05-c296-42d5-9d34-970f66bc7912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:56.871347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a19f05-c296-42d5-9d34-970f66bc7912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:56.872763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a19f05-c296-42d5-9d34-970f66bc7912 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:56.899292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 899/1787] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:13:57.471613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af842706-c687-477b-b33c-aacaa2de8c98 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:57.471997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af842706-c687-477b-b33c-aacaa2de8c98 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:57.473209 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af842706-c687-477b-b33c-aacaa2de8c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:57.507710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af842706-c687-477b-b33c-aacaa2de8c98 None None] MFA Rules not processed for user `d56ce8a772d7417eb4224f3e13cc0759`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:57.509633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af842706-c687-477b-b33c-aacaa2de8c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:57.544864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:57.552150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2bf01-0508-4423-b375-61331f622644 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:57.553176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2bf01-0508-4423-b375-61331f622644 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:57.553641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2bf01-0508-4423-b375-61331f622644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:57.591981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c9e2bf01-0508-4423-b375-61331f622644 None None] MFA Rules not processed for user `873694a34f1f40128a9c2eeaaa8424cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:57.593681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c9e2bf01-0508-4423-b375-61331f622644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:57.623792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 889/1788] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:13:57.811688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 900/1789] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:13:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:58.030446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca193930-6a17-4a59-b163-da48e8c56155 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:58.030952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca193930-6a17-4a59-b163-da48e8c56155 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:58.031380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca193930-6a17-4a59-b163-da48e8c56155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:58.058193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ca193930-6a17-4a59-b163-da48e8c56155 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:13:58.063439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ca193930-6a17-4a59-b163-da48e8c56155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:58.201356 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 890/1790] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:13:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:13:58.544453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2bf01-0508-4423-b375-61331f622644 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:58.546155 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c9e2bf01-0508-4423-b375-61331f622644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:59.026314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:13:59.155501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2bf01-0508-4423-b375-61331f622644 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:59.181176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef208fc1-0114-4f2f-9eb3-52dc8135d238 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:59.182727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef208fc1-0114-4f2f-9eb3-52dc8135d238 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:59.183026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef208fc1-0114-4f2f-9eb3-52dc8135d238 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:59.184200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef208fc1-0114-4f2f-9eb3-52dc8135d238 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:59.214106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef208fc1-0114-4f2f-9eb3-52dc8135d238 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:59.217387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef208fc1-0114-4f2f-9eb3-52dc8135d238 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:59.247583 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 901/1791] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:13:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:13:59.559200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca193930-6a17-4a59-b163-da48e8c56155 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:59.561510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ca193930-6a17-4a59-b163-da48e8c56155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:13:59.596368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca193930-6a17-4a59-b163-da48e8c56155 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:13:59.604155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:13:59.605286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:13:59.605792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:13:59.606241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] PATH_INFO: `/v3/projects/1639b5346bf941d6b3b36b0f43d412ee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:13:59.608374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1639b5346bf941d6b3b36b0f43d412ee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:13:59.611959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:13:59.780558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1639b5346bf941d6b3b36b0f43d412ee', 'request_id': 'req-3c924ae9-1710-43fb-9ecc-c2e3405033ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:59.800688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1639b5346bf941d6b3b36b0f43d412ee', 'request_id': 'req-3c924ae9-1710-43fb-9ecc-c2e3405033ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:59.823441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1639b5346bf941d6b3b36b0f43d412ee', 'request_id': 'req-3c924ae9-1710-43fb-9ecc-c2e3405033ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:59.860025 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] The token cache is being invalidate because project 1639b5346bf941d6b3b36b0f43d412ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:13:59.860344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:59.864432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:13:59.873316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 891/1792] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:13:59 2022] DELETE /identity/v3/projects/1639b5346bf941d6b3b36b0f43d412ee => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:13:59.874092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef208fc1-0114-4f2f-9eb3-52dc8135d238 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:13:59.912360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef208fc1-0114-4f2f-9eb3-52dc8135d238 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:00.146976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:00.148152 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:00.148536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:00.148942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] PATH_INFO: `/v3/users/3efc60022a1944cf86eae3da89309861` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:00.151519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3efc60022a1944cf86eae3da89309861)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:00.156386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:00.268747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3efc60022a1944cf86eae3da89309861'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:00.303702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3efc60022a1944cf86eae3da89309861'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:00.320966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3efc60022a1944cf86eae3da89309861'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:00.322029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3efc60022a1944cf86eae3da89309861'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:00.325197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3efc60022a1944cf86eae3da89309861'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:00.367840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 902/1793] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:13:59 2022] DELETE /identity/v3/users/3efc60022a1944cf86eae3da89309861 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:00.500748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:00.502709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:00.517255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c924ae9-1710-43fb-9ecc-c2e3405033ee admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:00.549513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:00.553018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:00.686533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:00.723730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:00.778752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:00.782089 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:00.782385 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:00.783819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] PATH_INFO: `/v3/users/26c55f1bdef749938b3cd8d66dcba755` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:00.788843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c55f1bdef749938b3cd8d66dcba755)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:00.798724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5488c1c-9eb5-4f7e-9d33-a105349b1a0e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:00.799196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:00.809079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00bbb9-04a1-4315-8051-b653a54fe3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:00.809796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00bbb9-04a1-4315-8051-b653a54fe3ae service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:00.810076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00bbb9-04a1-4315-8051-b653a54fe3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:00.810349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00bbb9-04a1-4315-8051-b653a54fe3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:00.815614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fd00bbb9-04a1-4315-8051-b653a54fe3ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:01.020815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00bbb9-04a1-4315-8051-b653a54fe3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:01.024964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00bbb9-04a1-4315-8051-b653a54fe3ae service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:01.053709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c55f1bdef749938b3cd8d66dcba755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:01.060232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 903/1794] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:01.123966 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c55f1bdef749938b3cd8d66dcba755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:01.144652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c55f1bdef749938b3cd8d66dcba755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:01.188752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c55f1bdef749938b3cd8d66dcba755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:01.189888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c55f1bdef749938b3cd8d66dcba755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:01.197570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 892/1795] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:00 2022] DELETE /identity/v3/users/26c55f1bdef749938b3cd8d66dcba755 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:01.202193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f8796-079c-47cd-8710-5b7dd48c6082 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:01.202802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f8796-079c-47cd-8710-5b7dd48c6082 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:01.203036 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f8796-079c-47cd-8710-5b7dd48c6082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:01.256961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-672f8796-079c-47cd-8710-5b7dd48c6082 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:01.266082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-672f8796-079c-47cd-8710-5b7dd48c6082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:01.574558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 904/1796] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:01.632574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:01.634307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:01.844936 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd497f3-4f9e-4f48-aacb-e28d1e9266bc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:01.870054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8e37f-4868-4e2a-ae64-a7a8c4ef8f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:01.872353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8e37f-4868-4e2a-ae64-a7a8c4ef8f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:01.873757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8e37f-4868-4e2a-ae64-a7a8c4ef8f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:01.874287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8e37f-4868-4e2a-ae64-a7a8c4ef8f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:01.909660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8e37f-4868-4e2a-ae64-a7a8c4ef8f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:01.913124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8e37f-4868-4e2a-ae64-a7a8c4ef8f63 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:01.972608 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 893/1797] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:04.357257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1e4d8-b252-4205-a440-c28552fb691b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:04.357817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1e4d8-b252-4205-a440-c28552fb691b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:04.357817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1e4d8-b252-4205-a440-c28552fb691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:04.417965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-01e1e4d8-b252-4205-a440-c28552fb691b None None] MFA Rules not processed for user `08b3093a7415419cbb6d50701b09b7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:04.419381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-01e1e4d8-b252-4205-a440-c28552fb691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:04.471795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 905/1798] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Jun 21 15:14:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:04.719800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8e37f-4868-4e2a-ae64-a7a8c4ef8f63 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:04.722685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-48b8e37f-4868-4e2a-ae64-a7a8c4ef8f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:04.759447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8e37f-4868-4e2a-ae64-a7a8c4ef8f63 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:04.769610 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c4140-694d-442a-bdcd-ecd4c407a5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:04.771429 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c4140-694d-442a-bdcd-ecd4c407a5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:04.772013 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c4140-694d-442a-bdcd-ecd4c407a5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:04.772434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c4140-694d-442a-bdcd-ecd4c407a5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:04.793223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c4140-694d-442a-bdcd-ecd4c407a5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:04.795138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c4140-694d-442a-bdcd-ecd4c407a5c7 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:04.810007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1e4d8-b252-4205-a440-c28552fb691b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:04.821638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 894/1799] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:04.823570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1e4d8-b252-4205-a440-c28552fb691b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:04.829821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae3d1b-b01e-402f-b037-0ef9c90692c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:04.829821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae3d1b-b01e-402f-b037-0ef9c90692c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:04.829993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae3d1b-b01e-402f-b037-0ef9c90692c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:04.830131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae3d1b-b01e-402f-b037-0ef9c90692c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:04.867006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c4140-694d-442a-bdcd-ecd4c407a5c7 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:04.868926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-299c4140-694d-442a-bdcd-ecd4c407a5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:04.871610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae3d1b-b01e-402f-b037-0ef9c90692c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:04.874851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae3d1b-b01e-402f-b037-0ef9c90692c0 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:04.906997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 906/1800] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:04.914205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c4140-694d-442a-bdcd-ecd4c407a5c7 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:04.933507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:04.936581 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:04.946870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:04.947607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] PATH_INFO: `/v3/users/c8d6ed71f89d4e60a1452a6c2a1c7530` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:04.955416 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d6ed71f89d4e60a1452a6c2a1c7530)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:04.959313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:05.092479 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d6ed71f89d4e60a1452a6c2a1c7530'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.104465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:05.137609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d6ed71f89d4e60a1452a6c2a1c7530'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.149135 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d6ed71f89d4e60a1452a6c2a1c7530'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.166725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d6ed71f89d4e60a1452a6c2a1c7530'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.170585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d6ed71f89d4e60a1452a6c2a1c7530'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.187829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 895/1801] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:04 2022] DELETE /identity/v3/users/c8d6ed71f89d4e60a1452a6c2a1c7530 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:05.192879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c1833-d2b4-4b04-929c-7ad29305f7ae None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:05.193172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c1833-d2b4-4b04-929c-7ad29305f7ae None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:05.193546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c1833-d2b4-4b04-929c-7ad29305f7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:05.226966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7f0c1833-d2b4-4b04-929c-7ad29305f7ae None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:05.227998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:05.229439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:05.238640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7f0c1833-d2b4-4b04-929c-7ad29305f7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:05.432508 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 907/1802] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:05.475150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829a48-2e87-44ca-a7eb-d43ee27fb19b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:05.482122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c1833-d2b4-4b04-929c-7ad29305f7ae None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:05.483901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7f0c1833-d2b4-4b04-929c-7ad29305f7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:05.486116 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:05.487691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:05.488048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:05.488331 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] PATH_INFO: `/v3/projects/8e1bfbedd757424f9722949b897032e2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:05.490699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1bfbedd757424f9722949b897032e2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:05.495365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:05.503267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:05.603224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1bfbedd757424f9722949b897032e2', 'request_id': 'req-a7e5dfff-395e-4764-9e39-bc533657cf82'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.616459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1bfbedd757424f9722949b897032e2', 'request_id': 'req-a7e5dfff-395e-4764-9e39-bc533657cf82'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.624563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c1833-d2b4-4b04-929c-7ad29305f7ae None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:05.636896 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1bfbedd757424f9722949b897032e2', 'request_id': 'req-a7e5dfff-395e-4764-9e39-bc533657cf82'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.662993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] The token cache is being invalidate because project 8e1bfbedd757424f9722949b897032e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:05.663534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.670914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7e5dfff-395e-4764-9e39-bc533657cf82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:05.673178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 896/1803] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:05 2022] DELETE /identity/v3/projects/8e1bfbedd757424f9722949b897032e2 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:05.678129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0fc11-475b-4940-9e45-ff5860bc34f6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:05.678613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0fc11-475b-4940-9e45-ff5860bc34f6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:05.679059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0fc11-475b-4940-9e45-ff5860bc34f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:05.728508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-81d0fc11-475b-4940-9e45-ff5860bc34f6 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:05.730467 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81d0fc11-475b-4940-9e45-ff5860bc34f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:05.775422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86568a7b-3e2b-43bd-b6cb-ddc2f0da72f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:05.782880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86568a7b-3e2b-43bd-b6cb-ddc2f0da72f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:05.783344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86568a7b-3e2b-43bd-b6cb-ddc2f0da72f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:05.784386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86568a7b-3e2b-43bd-b6cb-ddc2f0da72f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:05.795366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86568a7b-3e2b-43bd-b6cb-ddc2f0da72f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:05.929544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 897/1804] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:05.942422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db4c3c-ba65-46ce-9940-c4d7d7ff0a72 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:05.942541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db4c3c-ba65-46ce-9940-c4d7d7ff0a72 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:05.942812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db4c3c-ba65-46ce-9940-c4d7d7ff0a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:05.968469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:05.992782 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86568a7b-3e2b-43bd-b6cb-ddc2f0da72f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:05.994570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86568a7b-3e2b-43bd-b6cb-ddc2f0da72f5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:05.999332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-23db4c3c-ba65-46ce-9940-c4d7d7ff0a72 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:06.000794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23db4c3c-ba65-46ce-9940-c4d7d7ff0a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:06.025230 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 908/1805] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:06.026515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 898/1806] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:06.032853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86568a7b-3e2b-43bd-b6cb-ddc2f0da72f5 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:06.061054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86568a7b-3e2b-43bd-b6cb-ddc2f0da72f5 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:06.065817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db4c3c-ba65-46ce-9940-c4d7d7ff0a72 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:06.067960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23db4c3c-ba65-46ce-9940-c4d7d7ff0a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:06.070424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25cb5d-dcd8-454e-a811-943511880e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:06.071204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25cb5d-dcd8-454e-a811-943511880e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:06.071568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25cb5d-dcd8-454e-a811-943511880e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:06.072215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25cb5d-dcd8-454e-a811-943511880e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:06.073318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25cb5d-dcd8-454e-a811-943511880e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:14:06.073729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25cb5d-dcd8-454e-a811-943511880e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:06.075525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25cb5d-dcd8-454e-a811-943511880e83 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:06.090967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db4c3c-ba65-46ce-9940-c4d7d7ff0a72 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:06.093506 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 909/1807] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:14:06.097885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25cb5d-dcd8-454e-a811-943511880e83 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:06.102599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:06.103699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:06.104134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:06.104562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] PATH_INFO: `/v3/projects/9530fb891388460281b745ee4e54b6c0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:06.106117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9530fb891388460281b745ee4e54b6c0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:06.108309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:06.120451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25cb5d-dcd8-454e-a811-943511880e83 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:06.138642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6ad2c-5e2e-4c56-ae3a-3f1f08471bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:06.139455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ad2c-5e2e-4c56-ae3a-3f1f08471bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:06.139818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ad2c-5e2e-4c56-ae3a-3f1f08471bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:06.140183 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ad2c-5e2e-4c56-ae3a-3f1f08471bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:06.141111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6ad2c-5e2e-4c56-ae3a-3f1f08471bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:06.144784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6ad2c-5e2e-4c56-ae3a-3f1f08471bcf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:06.212156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 910/1808] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:06 2022] POST /identity/v3/projects => generated 393 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:06.216660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6ad2c-5e2e-4c56-ae3a-3f1f08471bcf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:06.242251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9530fb891388460281b745ee4e54b6c0', 'request_id': 'req-b1eea627-5f2a-4fa3-a504-05e953487c5f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.252125 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9530fb891388460281b745ee4e54b6c0', 'request_id': 'req-b1eea627-5f2a-4fa3-a504-05e953487c5f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.259608 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9530fb891388460281b745ee4e54b6c0', 'request_id': 'req-b1eea627-5f2a-4fa3-a504-05e953487c5f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.274466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] The token cache is being invalidate because project 9530fb891388460281b745ee4e54b6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:06.274775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.275738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.277925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 899/1809] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:06 2022] DELETE /identity/v3/projects/9530fb891388460281b745ee4e54b6c0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:06.283407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:06.285827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:06.389969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:06.464571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6ad2c-5e2e-4c56-ae3a-3f1f08471bcf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:06.518009 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eea627-5f2a-4fa3-a504-05e953487c5f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:06.527914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:06.528999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:06.529756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:06.531346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] PATH_INFO: `/v3/users/056493a0af32445a8cde285a18613712` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:06.534300 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=056493a0af32445a8cde285a18613712)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:06.537313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:06.607012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '056493a0af32445a8cde285a18613712'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.625743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '056493a0af32445a8cde285a18613712'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.642920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '056493a0af32445a8cde285a18613712'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.668737 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '056493a0af32445a8cde285a18613712'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.670946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '056493a0af32445a8cde285a18613712'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:06.672800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ae1eb-d039-4268-a36e-f0c11f174eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:06.675839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ae1eb-d039-4268-a36e-f0c11f174eba admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:06.678247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ae1eb-d039-4268-a36e-f0c11f174eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:06.678382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:06.680083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ae1eb-d039-4268-a36e-f0c11f174eba admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:06.681790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ae1eb-d039-4268-a36e-f0c11f174eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:06.689892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ae1eb-d039-4268-a36e-f0c11f174eba admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:06.697765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 900/1810] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:06 2022] DELETE /identity/v3/users/056493a0af32445a8cde285a18613712 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:06.765207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 911/1811] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:06 2022] POST /identity/v3/users => generated 297 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:06.769193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:06.771465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:06.997021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d8c8c-93a9-4758-b760-eb5e5cff00e2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:07.024231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1723-3d3c-4e38-936c-e41407182c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:07.027018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1723-3d3c-4e38-936c-e41407182c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:07.028119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1723-3d3c-4e38-936c-e41407182c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:07.029310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1723-3d3c-4e38-936c-e41407182c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:07.032241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca1723-3d3c-4e38-936c-e41407182c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:07.044356 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca1723-3d3c-4e38-936c-e41407182c34 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:07.080822 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 901/1812] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:07.084968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ae1eb-d039-4268-a36e-f0c11f174eba admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:07.101655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ae1eb-d039-4268-a36e-f0c11f174eba admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:07.113459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b69e6-7ef4-4f2e-8a78-e46d27dc4d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:07.114307 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b69e6-7ef4-4f2e-8a78-e46d27dc4d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:07.114542 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b69e6-7ef4-4f2e-8a78-e46d27dc4d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:07.115073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b69e6-7ef4-4f2e-8a78-e46d27dc4d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:07.115821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b69e6-7ef4-4f2e-8a78-e46d27dc4d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:07.123033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b69e6-7ef4-4f2e-8a78-e46d27dc4d87 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:07.157351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 912/1813] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:07.163444 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1723-3d3c-4e38-936c-e41407182c34 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:07.187504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1723-3d3c-4e38-936c-e41407182c34 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:07.193441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d0137-6963-4358-ac7a-e7581ba7720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:07.196817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d0137-6963-4358-ac7a-e7581ba7720c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:07.197265 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d0137-6963-4358-ac7a-e7581ba7720c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:07.197732 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d0137-6963-4358-ac7a-e7581ba7720c admin admin] PATH_INFO: `/v3/projects/0dd92511346e4c9eb843e0feff0c9207/users/127f9efaccb84140b9c3d9526a598c81/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:07.249267 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d0137-6963-4358-ac7a-e7581ba7720c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd92511346e4c9eb843e0feff0c9207, user_id=127f9efaccb84140b9c3d9526a598c81, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:07.262427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d0137-6963-4358-ac7a-e7581ba7720c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:07.317726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 902/1814] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:07 2022] PUT /identity/v3/projects/0dd92511346e4c9eb843e0feff0c9207/users/127f9efaccb84140b9c3d9526a598c81/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:07.330160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1294b-2508-463d-ac04-7151f662443d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:07.330699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1294b-2508-463d-ac04-7151f662443d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:07.331150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1294b-2508-463d-ac04-7151f662443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:07.415051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-21b1294b-2508-463d-ac04-7151f662443d None None] MFA Rules not processed for user `127f9efaccb84140b9c3d9526a598c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:07.418182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-21b1294b-2508-463d-ac04-7151f662443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:07.603499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 913/1815] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:07.609071 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d0137-6963-4358-ac7a-e7581ba7720c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:07.805353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d0137-6963-4358-ac7a-e7581ba7720c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:07.820012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4672f-cabf-45b9-aea2-16c75122988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:07.821409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4672f-cabf-45b9-aea2-16c75122988b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:07.821728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4672f-cabf-45b9-aea2-16c75122988b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:07.823120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4672f-cabf-45b9-aea2-16c75122988b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:07.824369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4672f-cabf-45b9-aea2-16c75122988b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:07.833624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4672f-cabf-45b9-aea2-16c75122988b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:07.884367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 903/1816] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:07 2022] POST /identity/v3/projects => generated 393 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:07.889321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1294b-2508-463d-ac04-7151f662443d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:07.931853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1294b-2508-463d-ac04-7151f662443d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:08.093919 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:08.125425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327941-40be-4573-a16e-e684b0e8c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:08.128745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327941-40be-4573-a16e-e684b0e8c2ef admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:08.129620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327941-40be-4573-a16e-e684b0e8c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:08.130490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327941-40be-4573-a16e-e684b0e8c2ef admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:08.134374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327941-40be-4573-a16e-e684b0e8c2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:08.153047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327941-40be-4573-a16e-e684b0e8c2ef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:08.199227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4672f-cabf-45b9-aea2-16c75122988b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:08.209998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 914/1817] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:07 2022] POST /identity/v3/users => generated 303 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:08.221624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4672f-cabf-45b9-aea2-16c75122988b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:08.234344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594397-4d20-498c-9e88-2746df9b4615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:08.236570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594397-4d20-498c-9e88-2746df9b4615 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:08.238649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594397-4d20-498c-9e88-2746df9b4615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:08.240706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594397-4d20-498c-9e88-2746df9b4615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:08.244290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68594397-4d20-498c-9e88-2746df9b4615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:08.249404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68594397-4d20-498c-9e88-2746df9b4615 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:08.292299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327941-40be-4573-a16e-e684b0e8c2ef admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:08.304857 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 904/1818] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:14:08.312154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327941-40be-4573-a16e-e684b0e8c2ef admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:08.332132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089c460-2c4e-431d-95ba-ed275abc2f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:08.336473 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089c460-2c4e-431d-95ba-ed275abc2f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:08.337713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089c460-2c4e-431d-95ba-ed275abc2f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:08.339344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089c460-2c4e-431d-95ba-ed275abc2f49 admin admin] PATH_INFO: `/v3/projects/dbe02a509ab1477a8bbcdf9d5291ae65/users/dc27aa820a5e40ad8d17408d098ee72c/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:08.396744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089c460-2c4e-431d-95ba-ed275abc2f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe02a509ab1477a8bbcdf9d5291ae65, user_id=dc27aa820a5e40ad8d17408d098ee72c, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:08.413399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089c460-2c4e-431d-95ba-ed275abc2f49 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:08.453419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 915/1819] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:08 2022] PUT /identity/v3/projects/dbe02a509ab1477a8bbcdf9d5291ae65/users/dc27aa820a5e40ad8d17408d098ee72c/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:08.458003 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594397-4d20-498c-9e88-2746df9b4615 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:08.469715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089c460-2c4e-431d-95ba-ed275abc2f49 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:08.475909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594397-4d20-498c-9e88-2746df9b4615 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:08.479495 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0089c460-2c4e-431d-95ba-ed275abc2f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:08.627460 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:08.631368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089c460-2c4e-431d-95ba-ed275abc2f49 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:08.650014 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:08.650979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:08.651258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:08.651539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] PATH_INFO: `/v3/projects/b767156a2c494da586bc2830b9148bdc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:08.652964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b767156a2c494da586bc2830b9148bdc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:08.655067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:08.686934 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5abdd-cfc2-4039-8fd9-013dffdf366b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:08.689604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5abdd-cfc2-4039-8fd9-013dffdf366b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:08.689933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5abdd-cfc2-4039-8fd9-013dffdf366b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:08.696861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5abdd-cfc2-4039-8fd9-013dffdf366b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:08.698059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5abdd-cfc2-4039-8fd9-013dffdf366b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:08.704886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5abdd-cfc2-4039-8fd9-013dffdf366b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:08.751709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 905/1820] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:08.753717 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5abdd-cfc2-4039-8fd9-013dffdf366b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:08.778925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b767156a2c494da586bc2830b9148bdc', 'request_id': 'req-98170d73-b061-4364-9198-4b84ab298007'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:08.786825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5abdd-cfc2-4039-8fd9-013dffdf366b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:08.799820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b767156a2c494da586bc2830b9148bdc', 'request_id': 'req-98170d73-b061-4364-9198-4b84ab298007'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:08.813116 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b767156a2c494da586bc2830b9148bdc', 'request_id': 'req-98170d73-b061-4364-9198-4b84ab298007'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:08.854590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] The token cache is being invalidate because project b767156a2c494da586bc2830b9148bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:08.854823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:08.855525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:08.869856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 916/1821] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:08 2022] DELETE /identity/v3/projects/b767156a2c494da586bc2830b9148bdc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:08.870892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:08.872524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:09.000843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc5435-4168-4cde-ae48-713f65d3aa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:09.001716 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5435-4168-4cde-ae48-713f65d3aa8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:09.002418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:09.007281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5435-4168-4cde-ae48-713f65d3aa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:09.022106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5435-4168-4cde-ae48-713f65d3aa8f admin admin] PATH_INFO: `/v3/projects/dbe02a509ab1477a8bbcdf9d5291ae65/users/dc27aa820a5e40ad8d17408d098ee72c/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:09.031502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5435-4168-4cde-ae48-713f65d3aa8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe02a509ab1477a8bbcdf9d5291ae65, user_id=dc27aa820a5e40ad8d17408d098ee72c, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:09.038313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5435-4168-4cde-ae48-713f65d3aa8f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:09.040355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170d73-b061-4364-9198-4b84ab298007 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:09.053630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 906/1822] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:08 2022] PUT /identity/v3/projects/dbe02a509ab1477a8bbcdf9d5291ae65/users/dc27aa820a5e40ad8d17408d098ee72c/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:09.069385 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80186ba5-3257-4c1a-afd8-8316a8bc8282 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:09.070184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80186ba5-3257-4c1a-afd8-8316a8bc8282 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:09.070766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80186ba5-3257-4c1a-afd8-8316a8bc8282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:09.087138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:09.095226 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:09.097212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:09.098891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] PATH_INFO: `/v3/users/d485df1fe7344e5dbcc797c273b85304` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:09.104104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d485df1fe7344e5dbcc797c273b85304)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:09.112142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:09.140498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-80186ba5-3257-4c1a-afd8-8316a8bc8282 None None] MFA Rules not processed for user `dc27aa820a5e40ad8d17408d098ee72c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:09.144393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-80186ba5-3257-4c1a-afd8-8316a8bc8282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:09.235742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd485df1fe7344e5dbcc797c273b85304'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:09.258242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd485df1fe7344e5dbcc797c273b85304'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:09.266746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd485df1fe7344e5dbcc797c273b85304'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:09.268049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd485df1fe7344e5dbcc797c273b85304'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:09.268915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f366f7fe-b3c4-4f84-85a8-91598a55f4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd485df1fe7344e5dbcc797c273b85304'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:09.314063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 917/1823] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:08 2022] DELETE /identity/v3/users/d485df1fe7344e5dbcc797c273b85304 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:09.317634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8990e-a16d-472e-8763-463619f05de5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:09.318001 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8990e-a16d-472e-8763-463619f05de5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:09.318373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8990e-a16d-472e-8763-463619f05de5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:09.320200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 918/1824] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:14:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:14:09.342944 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 907/1825] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:09.360943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01811c8-f116-4f9c-8f53-fae119672a1a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:09.360943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01811c8-f116-4f9c-8f53-fae119672a1a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:09.360943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01811c8-f116-4f9c-8f53-fae119672a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:09.376854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80186ba5-3257-4c1a-afd8-8316a8bc8282 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:09.385923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-80186ba5-3257-4c1a-afd8-8316a8bc8282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:09.421247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b01811c8-f116-4f9c-8f53-fae119672a1a None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:09.427229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b01811c8-f116-4f9c-8f53-fae119672a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:09.556446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80186ba5-3257-4c1a-afd8-8316a8bc8282 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:09.577407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:09.621980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 919/1826] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:09.653042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8212b-41c7-4fcc-b1c9-c04d10d3625d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:09.654026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8212b-41c7-4fcc-b1c9-c04d10d3625d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:09.654424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8212b-41c7-4fcc-b1c9-c04d10d3625d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:09.654745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8212b-41c7-4fcc-b1c9-c04d10d3625d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:09.850169 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8212b-41c7-4fcc-b1c9-c04d10d3625d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:09.851586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8212b-41c7-4fcc-b1c9-c04d10d3625d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:09.876039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 908/1827] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:09.989663 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01811c8-f116-4f9c-8f53-fae119672a1a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:09.993831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b01811c8-f116-4f9c-8f53-fae119672a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:10.013576 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8212b-41c7-4fcc-b1c9-c04d10d3625d service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:10.015758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a2c8212b-41c7-4fcc-b1c9-c04d10d3625d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:10.031880 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8212b-41c7-4fcc-b1c9-c04d10d3625d service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:10.042255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4e7a2-fbd7-4bc5-aaeb-fd23b9357fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:10.043032 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4e7a2-fbd7-4bc5-aaeb-fd23b9357fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:10.043513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4e7a2-fbd7-4bc5-aaeb-fd23b9357fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:10.043935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4e7a2-fbd7-4bc5-aaeb-fd23b9357fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:10.047659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eea4e7a2-fbd7-4bc5-aaeb-fd23b9357fe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:10.048124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01811c8-f116-4f9c-8f53-fae119672a1a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:10.063075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90fc2-26da-4a25-acbb-694169f9eae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:10.063755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90fc2-26da-4a25-acbb-694169f9eae1 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:10.064046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90fc2-26da-4a25-acbb-694169f9eae1 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:10.078075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90fc2-26da-4a25-acbb-694169f9eae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:10.091420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a90fc2-26da-4a25-acbb-694169f9eae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:10.094207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a90fc2-26da-4a25-acbb-694169f9eae1 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:10.108759 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 920/1828] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:10.202154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4e7a2-fbd7-4bc5-aaeb-fd23b9357fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:10.203879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4e7a2-fbd7-4bc5-aaeb-fd23b9357fe2 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:10.231569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 909/1829] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:11.305290 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90fc2-26da-4a25-acbb-694169f9eae1 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:11.307568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-25a90fc2-26da-4a25-acbb-694169f9eae1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:11.519749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:11.552272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90fc2-26da-4a25-acbb-694169f9eae1 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:11.561159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:11.563978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:11.564589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:11.565253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] PATH_INFO: `/v3/projects/c8b8162c5825479699c93e7c89379f69` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:11.568823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b8162c5825479699c93e7c89379f69)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:11.572160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:11.670425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b8162c5825479699c93e7c89379f69', 'request_id': 'req-2aa94eec-dac8-4d14-a78b-7d177b8e065d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:11.682669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b8162c5825479699c93e7c89379f69', 'request_id': 'req-2aa94eec-dac8-4d14-a78b-7d177b8e065d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:11.710548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b8162c5825479699c93e7c89379f69', 'request_id': 'req-2aa94eec-dac8-4d14-a78b-7d177b8e065d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:11.752926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] The token cache is being invalidate because project c8b8162c5825479699c93e7c89379f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:11.755713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:11.757884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2aa94eec-dac8-4d14-a78b-7d177b8e065d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:11.773189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd037f-1487-4900-b13b-a1b87691546d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:11.775218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd037f-1487-4900-b13b-a1b87691546d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:11.775791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd037f-1487-4900-b13b-a1b87691546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:11.778131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 921/1830] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:11 2022] DELETE /identity/v3/projects/c8b8162c5825479699c93e7c89379f69 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:11.830429 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-55bd037f-1487-4900-b13b-a1b87691546d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:11.835011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-55bd037f-1487-4900-b13b-a1b87691546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:11.969277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98067cb-f2ea-43c0-aa0c-0228c71f8682 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:11.969891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98067cb-f2ea-43c0-aa0c-0228c71f8682 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:11.970595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98067cb-f2ea-43c0-aa0c-0228c71f8682 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:11.978901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 922/1831] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:14:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:14:12.040255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 910/1832] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:12.054179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50326612-5fac-4e1c-8901-b3c0bdad7d16 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.055267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50326612-5fac-4e1c-8901-b3c0bdad7d16 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.055267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50326612-5fac-4e1c-8901-b3c0bdad7d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.106406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-50326612-5fac-4e1c-8901-b3c0bdad7d16 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:12.107861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-50326612-5fac-4e1c-8901-b3c0bdad7d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:12.124030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 923/1833] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:12.128602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd037f-1487-4900-b13b-a1b87691546d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.135807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:12.149602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd037f-1487-4900-b13b-a1b87691546d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:12.155438 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a961b4-5b7c-41ea-b3bf-b7cba7f19b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:12.156208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a961b4-5b7c-41ea-b3bf-b7cba7f19b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.156792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a961b4-5b7c-41ea-b3bf-b7cba7f19b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.157022 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a961b4-5b7c-41ea-b3bf-b7cba7f19b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.159433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a961b4-5b7c-41ea-b3bf-b7cba7f19b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:14:12.159890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a961b4-5b7c-41ea-b3bf-b7cba7f19b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:12.162327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a961b4-5b7c-41ea-b3bf-b7cba7f19b8d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:12.178561 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066771ea-ac8e-425c-b277-d24828c415cd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.178846 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066771ea-ac8e-425c-b277-d24828c415cd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.179128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066771ea-ac8e-425c-b277-d24828c415cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.202851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 911/1834] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:14:12.204072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a961b4-5b7c-41ea-b3bf-b7cba7f19b8d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.209545 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-066771ea-ac8e-425c-b277-d24828c415cd None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:12.211074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-066771ea-ac8e-425c-b277-d24828c415cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:12.217965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a961b4-5b7c-41ea-b3bf-b7cba7f19b8d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:12.230384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322221e-7cd3-4452-b5b1-137417c44766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:12.231207 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322221e-7cd3-4452-b5b1-137417c44766 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.231992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322221e-7cd3-4452-b5b1-137417c44766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.232354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322221e-7cd3-4452-b5b1-137417c44766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.233451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322221e-7cd3-4452-b5b1-137417c44766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:12.236575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322221e-7cd3-4452-b5b1-137417c44766 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:12.284023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 912/1835] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:12 2022] POST /identity/v3/projects => generated 357 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:12.289312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322221e-7cd3-4452-b5b1-137417c44766 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.306070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 924/1836] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:14:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:12.371160 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322221e-7cd3-4452-b5b1-137417c44766 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:12.385156 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b28302-8eb2-4bed-9b51-651ef939f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:12.386896 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28302-8eb2-4bed-9b51-651ef939f8fa admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.388103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28302-8eb2-4bed-9b51-651ef939f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.388840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b28302-8eb2-4bed-9b51-651ef939f8fa admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.389911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b28302-8eb2-4bed-9b51-651ef939f8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:12.397583 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b28302-8eb2-4bed-9b51-651ef939f8fa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:12.450705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 913/1837] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:12 2022] POST /identity/v3/users => generated 279 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:14:12.452348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066771ea-ac8e-425c-b277-d24828c415cd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.464632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b28302-8eb2-4bed-9b51-651ef939f8fa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.467091 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-50b28302-8eb2-4bed-9b51-651ef939f8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:12.467444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066771ea-ac8e-425c-b277-d24828c415cd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:12.477409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2822de-e472-443f-b893-cc16aefa0427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:12.480409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2822de-e472-443f-b893-cc16aefa0427 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.480743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2822de-e472-443f-b893-cc16aefa0427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.481024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2822de-e472-443f-b893-cc16aefa0427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.481834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2822de-e472-443f-b893-cc16aefa0427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:12.483538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2822de-e472-443f-b893-cc16aefa0427 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:12.498831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 925/1838] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:12.510908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2822de-e472-443f-b893-cc16aefa0427 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.524122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2822de-e472-443f-b893-cc16aefa0427 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:12.530255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e76135-e76f-48ea-ae4d-0e57c4a7a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:12.531524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e76135-e76f-48ea-ae4d-0e57c4a7a47c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.532026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e76135-e76f-48ea-ae4d-0e57c4a7a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.532713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e76135-e76f-48ea-ae4d-0e57c4a7a47c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.533630 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e76135-e76f-48ea-ae4d-0e57c4a7a47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:12.535365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e76135-e76f-48ea-ae4d-0e57c4a7a47c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:12.547894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 926/1839] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:12.552993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e76135-e76f-48ea-ae4d-0e57c4a7a47c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.565568 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e76135-e76f-48ea-ae4d-0e57c4a7a47c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:12.573242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dcddc-571d-4a36-a1bb-1b04a046898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:12.574413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dcddc-571d-4a36-a1bb-1b04a046898f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.574772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dcddc-571d-4a36-a1bb-1b04a046898f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.575125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dcddc-571d-4a36-a1bb-1b04a046898f admin admin] PATH_INFO: `/v3/projects/38621dc566bc4311950e061e73d2300d/users/54ce64ebc3fc4e568973fe37a1c7b8f4/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.589057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b28302-8eb2-4bed-9b51-651ef939f8fa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:12.596140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281cf8f-8271-4cb0-8c1c-1e8c4ff3f100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:12.596807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281cf8f-8271-4cb0-8c1c-1e8c4ff3f100 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.597093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281cf8f-8271-4cb0-8c1c-1e8c4ff3f100 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.598437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281cf8f-8271-4cb0-8c1c-1e8c4ff3f100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.598973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5dcddc-571d-4a36-a1bb-1b04a046898f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38621dc566bc4311950e061e73d2300d, user_id=54ce64ebc3fc4e568973fe37a1c7b8f4, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:12.603110 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5dcddc-571d-4a36-a1bb-1b04a046898f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:12.611108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281cf8f-8271-4cb0-8c1c-1e8c4ff3f100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:12.612654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281cf8f-8271-4cb0-8c1c-1e8c4ff3f100 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:12.626803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 914/1840] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:12.628154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 927/1841] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:12 2022] PUT /identity/v3/projects/38621dc566bc4311950e061e73d2300d/users/54ce64ebc3fc4e568973fe37a1c7b8f4/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:12.641997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd29cf-aaca-402d-96a6-0956a7716591 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.642295 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd29cf-aaca-402d-96a6-0956a7716591 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.642594 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd29cf-aaca-402d-96a6-0956a7716591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.667632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dcddc-571d-4a36-a1bb-1b04a046898f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.669529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cd5dcddc-571d-4a36-a1bb-1b04a046898f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:12.687498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-02fd29cf-aaca-402d-96a6-0956a7716591 None None] MFA Rules not processed for user `54ce64ebc3fc4e568973fe37a1c7b8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:12.688935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-02fd29cf-aaca-402d-96a6-0956a7716591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:12.711728 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:12.777632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:12.818104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dcddc-571d-4a36-a1bb-1b04a046898f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:12.826122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:12.827381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.830902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 915/1842] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:12 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:12.832257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.832736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] PATH_INFO: `/v3/projects/b2b433e200014040a07e9c398671c489` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.833877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd29cf-aaca-402d-96a6-0956a7716591 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.840597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b433e200014040a07e9c398671c489)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:12.843674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:12.846978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd29cf-aaca-402d-96a6-0956a7716591 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:12.853422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131c5db-556a-49ce-973a-93baca2b372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:12.854166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131c5db-556a-49ce-973a-93baca2b372e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:12.854472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131c5db-556a-49ce-973a-93baca2b372e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:12.854811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131c5db-556a-49ce-973a-93baca2b372e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:12.855922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131c5db-556a-49ce-973a-93baca2b372e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:12.857729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131c5db-556a-49ce-973a-93baca2b372e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:12.896621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 916/1843] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:12 2022] POST /identity/v3/projects => generated 355 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:12.901815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131c5db-556a-49ce-973a-93baca2b372e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:12.988466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b433e200014040a07e9c398671c489', 'request_id': 'req-9945dca0-a5c8-4791-b802-b5648e513d88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.006045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b433e200014040a07e9c398671c489', 'request_id': 'req-9945dca0-a5c8-4791-b802-b5648e513d88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.019323 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b433e200014040a07e9c398671c489', 'request_id': 'req-9945dca0-a5c8-4791-b802-b5648e513d88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.040369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131c5db-556a-49ce-973a-93baca2b372e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:13.045912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] The token cache is being invalidate because project b2b433e200014040a07e9c398671c489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:13.048599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.049338 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.055452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 928/1844] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:12 2022] DELETE /identity/v3/projects/b2b433e200014040a07e9c398671c489 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:13.060069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:13.064543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:13.241940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945dca0-a5c8-4791-b802-b5648e513d88 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:13.246291 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f84a-5357-4396-b816-be22b6d8e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:13.247036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f84a-5357-4396-b816-be22b6d8e27a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:13.247257 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f84a-5357-4396-b816-be22b6d8e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:13.247583 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f84a-5357-4396-b816-be22b6d8e27a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:13.248217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680f84a-5357-4396-b816-be22b6d8e27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:13.253719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:13.255719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:13.255719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:13.256275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] PATH_INFO: `/v3/users/161c0d8031554817b483c6312a620b01` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:13.257000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680f84a-5357-4396-b816-be22b6d8e27a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:13.259315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] RBAC: Authorizing `identity:delete_user(user_id=161c0d8031554817b483c6312a620b01)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:13.264611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:13.305316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 917/1845] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:12 2022] POST /identity/v3/users => generated 284 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:13.313105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f84a-5357-4396-b816-be22b6d8e27a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:13.315022 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5680f84a-5357-4396-b816-be22b6d8e27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:13.336665 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f84a-5357-4396-b816-be22b6d8e27a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:13.350898 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f854a-2b16-4cec-9d33-2f63da2fa7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:13.351567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f854a-2b16-4cec-9d33-2f63da2fa7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:13.351853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f854a-2b16-4cec-9d33-2f63da2fa7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:13.352131 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f854a-2b16-4cec-9d33-2f63da2fa7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:13.352863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f854a-2b16-4cec-9d33-2f63da2fa7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:13.354527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f854a-2b16-4cec-9d33-2f63da2fa7e5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:13.373392 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161c0d8031554817b483c6312a620b01'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.375962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:13.382672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 918/1846] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:13.386578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f854a-2b16-4cec-9d33-2f63da2fa7e5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:13.399787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f854a-2b16-4cec-9d33-2f63da2fa7e5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:13.400931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161c0d8031554817b483c6312a620b01'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.405921 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d72bc-a3f8-4e64-809a-eefd50ddd0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:13.406877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d72bc-a3f8-4e64-809a-eefd50ddd0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:13.407219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d72bc-a3f8-4e64-809a-eefd50ddd0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:13.407850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d72bc-a3f8-4e64-809a-eefd50ddd0f0 admin admin] PATH_INFO: `/v3/projects/2f88556a91c54d27a2cea11e534ba51a/users/0e28615cc2ce428cbdda9f83499c5611/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:13.413298 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161c0d8031554817b483c6312a620b01'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.414069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161c0d8031554817b483c6312a620b01'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.414702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161c0d8031554817b483c6312a620b01'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:13.433974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d72bc-a3f8-4e64-809a-eefd50ddd0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f88556a91c54d27a2cea11e534ba51a, user_id=0e28615cc2ce428cbdda9f83499c5611, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:13.436664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d72bc-a3f8-4e64-809a-eefd50ddd0f0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:13.437363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 929/1847] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:13 2022] DELETE /identity/v3/users/161c0d8031554817b483c6312a620b01 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:13.466706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 919/1848] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:13 2022] PUT /identity/v3/projects/2f88556a91c54d27a2cea11e534ba51a/users/0e28615cc2ce428cbdda9f83499c5611/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:13.472003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:13.474312 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:13.578902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d589d-f5fc-4448-8b01-91dd9e56833a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:13.674291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91161fa-3f7f-42f6-9929-9534c47862a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:13.674990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91161fa-3f7f-42f6-9929-9534c47862a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:13.675275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91161fa-3f7f-42f6-9929-9534c47862a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:13.675931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91161fa-3f7f-42f6-9929-9534c47862a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:13.677509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91161fa-3f7f-42f6-9929-9534c47862a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:13.679252 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91161fa-3f7f-42f6-9929-9534c47862a3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:13.700098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 930/1849] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:14:13.701421 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d72bc-a3f8-4e64-809a-eefd50ddd0f0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:13.712152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d72bc-a3f8-4e64-809a-eefd50ddd0f0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:13.717663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894596-91be-416a-90a8-a9fac37e45e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:13.719617 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894596-91be-416a-90a8-a9fac37e45e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:13.720136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894596-91be-416a-90a8-a9fac37e45e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:13.720387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894596-91be-416a-90a8-a9fac37e45e7 admin admin] PATH_INFO: `/v3/projects/2f88556a91c54d27a2cea11e534ba51a/users/0e28615cc2ce428cbdda9f83499c5611/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:13.722384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73894596-91be-416a-90a8-a9fac37e45e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f88556a91c54d27a2cea11e534ba51a, user_id=0e28615cc2ce428cbdda9f83499c5611, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:13.726665 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73894596-91be-416a-90a8-a9fac37e45e7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:13.734777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:13.741587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 920/1850] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:13 2022] PUT /identity/v3/projects/2f88556a91c54d27a2cea11e534ba51a/users/0e28615cc2ce428cbdda9f83499c5611/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:13.753624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0b007-f0ce-49f3-b4c3-046503e92d73 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:13.754199 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0b007-f0ce-49f3-b4c3-046503e92d73 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:13.754760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0b007-f0ce-49f3-b4c3-046503e92d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:13.794212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-86a0b007-f0ce-49f3-b4c3-046503e92d73 None None] MFA Rules not processed for user `0e28615cc2ce428cbdda9f83499c5611`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:13.795767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86a0b007-f0ce-49f3-b4c3-046503e92d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:13.922142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:13.944138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894596-91be-416a-90a8-a9fac37e45e7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:13.951068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-73894596-91be-416a-90a8-a9fac37e45e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:13.965277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 931/1851] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:13 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:13.977215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0b007-f0ce-49f3-b4c3-046503e92d73 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:13.978685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86a0b007-f0ce-49f3-b4c3-046503e92d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:14.050435 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0b007-f0ce-49f3-b4c3-046503e92d73 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.056381 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894596-91be-416a-90a8-a9fac37e45e7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.056546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6b5de-e03f-4ce2-a834-7ce6961830dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.057110 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6b5de-e03f-4ce2-a834-7ce6961830dc service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.057369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6b5de-e03f-4ce2-a834-7ce6961830dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.057671 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6b5de-e03f-4ce2-a834-7ce6961830dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.062690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.063621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.064285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.064400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] PATH_INFO: `/v3/projects/816f180b1e8c460e835dd7edf1831b6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.065755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816f180b1e8c460e835dd7edf1831b6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.068563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.069577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6b5de-e03f-4ce2-a834-7ce6961830dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.071171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6b5de-e03f-4ce2-a834-7ce6961830dc service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.081300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 932/1852] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:13 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:14.132488 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816f180b1e8c460e835dd7edf1831b6e', 'request_id': 'req-16d1ffb6-336d-4352-b41a-cd3226626792'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:14.142385 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816f180b1e8c460e835dd7edf1831b6e', 'request_id': 'req-16d1ffb6-336d-4352-b41a-cd3226626792'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:14.149261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816f180b1e8c460e835dd7edf1831b6e', 'request_id': 'req-16d1ffb6-336d-4352-b41a-cd3226626792'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:14.168312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] The token cache is being invalidate because project 816f180b1e8c460e835dd7edf1831b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:14.168708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:14.169436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16d1ffb6-336d-4352-b41a-cd3226626792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:14.171190 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6b5de-e03f-4ce2-a834-7ce6961830dc service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:14.171799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 921/1853] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:13 2022] DELETE /identity/v3/projects/816f180b1e8c460e835dd7edf1831b6e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:14.177986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee075309-718b-430d-9108-5f7c132f4036 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.178275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee075309-718b-430d-9108-5f7c132f4036 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.178555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee075309-718b-430d-9108-5f7c132f4036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.181719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6b5de-e03f-4ce2-a834-7ce6961830dc service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.198190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ee075309-718b-430d-9108-5f7c132f4036 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:14.203468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ee075309-718b-430d-9108-5f7c132f4036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:14.259521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543db63-2fef-4329-b923-e8f213f7f96c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.260355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543db63-2fef-4329-b923-e8f213f7f96c service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.260743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543db63-2fef-4329-b923-e8f213f7f96c service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.261503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543db63-2fef-4329-b923-e8f213f7f96c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.263731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0543db63-2fef-4329-b923-e8f213f7f96c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:14.306660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 922/1854] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:14.317856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98b5c6-222c-46ef-baa5-76b5fb5cade2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.318629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98b5c6-222c-46ef-baa5-76b5fb5cade2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.319011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98b5c6-222c-46ef-baa5-76b5fb5cade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.346637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0b98b5c6-222c-46ef-baa5-76b5fb5cade2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:14.349507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0b98b5c6-222c-46ef-baa5-76b5fb5cade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:14.350923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543db63-2fef-4329-b923-e8f213f7f96c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.352591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543db63-2fef-4329-b923-e8f213f7f96c service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.357599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 923/1855] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:14.361321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98b5c6-222c-46ef-baa5-76b5fb5cade2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:14.362538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 933/1856] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:14 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:14.372709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98b5c6-222c-46ef-baa5-76b5fb5cade2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.378216 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001d959-a2b3-4225-a6e8-a4984f75b318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.378987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001d959-a2b3-4225-a6e8-a4984f75b318 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.379533 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001d959-a2b3-4225-a6e8-a4984f75b318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.379920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001d959-a2b3-4225-a6e8-a4984f75b318 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.381446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001d959-a2b3-4225-a6e8-a4984f75b318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:14:14.381873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001d959-a2b3-4225-a6e8-a4984f75b318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.383638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001d959-a2b3-4225-a6e8-a4984f75b318 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.398117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 924/1857] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:14:14.402474 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543db63-2fef-4329-b923-e8f213f7f96c service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:14.416772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543db63-2fef-4329-b923-e8f213f7f96c service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.422117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d45e-e829-4420-9f9f-5e9f600d29d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.422790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d45e-e829-4420-9f9f-5e9f600d29d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.423075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d45e-e829-4420-9f9f-5e9f600d29d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.423357 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028d45e-e829-4420-9f9f-5e9f600d29d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.424056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028d45e-e829-4420-9f9f-5e9f600d29d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.426004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028d45e-e829-4420-9f9f-5e9f600d29d1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.454876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 934/1858] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:14 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:14:14.460051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001d959-a2b3-4225-a6e8-a4984f75b318 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:14.470952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001d959-a2b3-4225-a6e8-a4984f75b318 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.480638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:14.550673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecccef0-ac04-458b-9811-d2a5593f5377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.552475 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecccef0-ac04-458b-9811-d2a5593f5377 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.552770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecccef0-ac04-458b-9811-d2a5593f5377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.553049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecccef0-ac04-458b-9811-d2a5593f5377 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.553788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecccef0-ac04-458b-9811-d2a5593f5377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.555693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecccef0-ac04-458b-9811-d2a5593f5377 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.585200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 925/1859] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:14 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:14:14.586435 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d45e-e829-4420-9f9f-5e9f600d29d1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:14.601505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028d45e-e829-4420-9f9f-5e9f600d29d1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.610282 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e3280-8ac5-4cd2-89b7-67b50a856899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.611002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3280-8ac5-4cd2-89b7-67b50a856899 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.611311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3280-8ac5-4cd2-89b7-67b50a856899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.611572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3280-8ac5-4cd2-89b7-67b50a856899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.612324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e3280-8ac5-4cd2-89b7-67b50a856899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.614855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e3280-8ac5-4cd2-89b7-67b50a856899 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.631205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 935/1860] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:14.635365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecccef0-ac04-458b-9811-d2a5593f5377 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:14.646619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecccef0-ac04-458b-9811-d2a5593f5377 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.651561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796c60c-26c3-4dd3-b78f-b1401db5bab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.652251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c60c-26c3-4dd3-b78f-b1401db5bab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.652537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c60c-26c3-4dd3-b78f-b1401db5bab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.652841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c60c-26c3-4dd3-b78f-b1401db5bab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.653613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796c60c-26c3-4dd3-b78f-b1401db5bab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.655205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796c60c-26c3-4dd3-b78f-b1401db5bab6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.673614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 926/1861] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:14.675090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e3280-8ac5-4cd2-89b7-67b50a856899 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:14.686237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e3280-8ac5-4cd2-89b7-67b50a856899 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.694220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e760ad-5022-4d43-8a7a-ddafe437c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.696180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e760ad-5022-4d43-8a7a-ddafe437c1da admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.696573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e760ad-5022-4d43-8a7a-ddafe437c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.696994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e760ad-5022-4d43-8a7a-ddafe437c1da admin admin] PATH_INFO: `/v3/projects/c3c373c261cc42359442d6e817b76e0c/users/c1c9ecc3a61346faa00fc7d14121bacf/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.719949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e760ad-5022-4d43-8a7a-ddafe437c1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c373c261cc42359442d6e817b76e0c, user_id=c1c9ecc3a61346faa00fc7d14121bacf, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.722916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e760ad-5022-4d43-8a7a-ddafe437c1da admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.729402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:14.747437 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 936/1862] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:14 2022] PUT /identity/v3/projects/c3c373c261cc42359442d6e817b76e0c/users/c1c9ecc3a61346faa00fc7d14121bacf/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:14.760938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e46a6-83a6-49d6-b97e-7303a3507dbb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.761323 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e46a6-83a6-49d6-b97e-7303a3507dbb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.762136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e46a6-83a6-49d6-b97e-7303a3507dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.802506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dd3e46a6-83a6-49d6-b97e-7303a3507dbb None None] MFA Rules not processed for user `c1c9ecc3a61346faa00fc7d14121bacf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:14.803741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dd3e46a6-83a6-49d6-b97e-7303a3507dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:14.876906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 927/1863] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:14.878009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e760ad-5022-4d43-8a7a-ddafe437c1da admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:14.955592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e760ad-5022-4d43-8a7a-ddafe437c1da admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:14.960308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4154b8-1c15-44c8-9ba5-b082bb5858ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:14.961218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4154b8-1c15-44c8-9ba5-b082bb5858ce admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:14.961935 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4154b8-1c15-44c8-9ba5-b082bb5858ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:14.962068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4154b8-1c15-44c8-9ba5-b082bb5858ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:14.962784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4154b8-1c15-44c8-9ba5-b082bb5858ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:14.964699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4154b8-1c15-44c8-9ba5-b082bb5858ce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:14.994102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 937/1864] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:14 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:14:14.998630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e46a6-83a6-49d6-b97e-7303a3507dbb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:15.012100 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e46a6-83a6-49d6-b97e-7303a3507dbb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:15.072660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f663076-47d2-4057-8fd0-622daf9fdcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:15.073336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663076-47d2-4057-8fd0-622daf9fdcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.073663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663076-47d2-4057-8fd0-622daf9fdcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.073948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663076-47d2-4057-8fd0-622daf9fdcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.074641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f663076-47d2-4057-8fd0-622daf9fdcf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:15.076580 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f663076-47d2-4057-8fd0-622daf9fdcf7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:15.098641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 928/1865] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:14 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:15.102539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4154b8-1c15-44c8-9ba5-b082bb5858ce admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:15.112792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4154b8-1c15-44c8-9ba5-b082bb5858ce admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:15.118058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa2a5d-c420-40b0-af30-e202b5f6d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:15.118941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa2a5d-c420-40b0-af30-e202b5f6d1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.119067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa2a5d-c420-40b0-af30-e202b5f6d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.119283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa2a5d-c420-40b0-af30-e202b5f6d1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.120012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa2a5d-c420-40b0-af30-e202b5f6d1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:15.121681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa2a5d-c420-40b0-af30-e202b5f6d1d7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:15.133747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 938/1866] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:14:15.138058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f663076-47d2-4057-8fd0-622daf9fdcf7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:15.148667 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f663076-47d2-4057-8fd0-622daf9fdcf7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:15.153500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba609-555c-45f9-a952-7732bbba3642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:15.154447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba609-555c-45f9-a952-7732bbba3642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.154735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba609-555c-45f9-a952-7732bbba3642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.155017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba609-555c-45f9-a952-7732bbba3642 admin admin] PATH_INFO: `/v3/projects/a8ac00c0545e4d78bc8a376b07d97f0a/users/5e2ef845120d4a2ea736581c3d198e2c/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.158406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:15.172772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ba609-555c-45f9-a952-7732bbba3642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ac00c0545e4d78bc8a376b07d97f0a, user_id=5e2ef845120d4a2ea736581c3d198e2c, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:15.175557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ba609-555c-45f9-a952-7732bbba3642 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:15.188758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 929/1867] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:15 2022] PUT /identity/v3/projects/a8ac00c0545e4d78bc8a376b07d97f0a/users/5e2ef845120d4a2ea736581c3d198e2c/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:15.192852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa2a5d-c420-40b0-af30-e202b5f6d1d7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:15.202803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa2a5d-c420-40b0-af30-e202b5f6d1d7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:15.260303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ab779-9559-4e43-981d-7c33c1216ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:15.260993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ab779-9559-4e43-981d-7c33c1216ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.261397 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ab779-9559-4e43-981d-7c33c1216ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.261745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ab779-9559-4e43-981d-7c33c1216ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.262557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ab779-9559-4e43-981d-7c33c1216ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:15.264127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ab779-9559-4e43-981d-7c33c1216ac9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:15.274760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 939/1868] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:15.279097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba609-555c-45f9-a952-7732bbba3642 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:15.291984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba609-555c-45f9-a952-7732bbba3642 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:15.296253 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d033e-3174-406b-b1b6-7dc841089c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:15.297122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d033e-3174-406b-b1b6-7dc841089c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.297401 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d033e-3174-406b-b1b6-7dc841089c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.297766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d033e-3174-406b-b1b6-7dc841089c71 admin admin] PATH_INFO: `/v3/projects/a8ac00c0545e4d78bc8a376b07d97f0a/users/5e2ef845120d4a2ea736581c3d198e2c/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.299744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d033e-3174-406b-b1b6-7dc841089c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ac00c0545e4d78bc8a376b07d97f0a, user_id=5e2ef845120d4a2ea736581c3d198e2c, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:15.303352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d033e-3174-406b-b1b6-7dc841089c71 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:15.313453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 930/1869] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:15 2022] PUT /identity/v3/projects/a8ac00c0545e4d78bc8a376b07d97f0a/users/5e2ef845120d4a2ea736581c3d198e2c/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:15.323708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c41ba-fb8e-4ca8-9e5e-ce8bed5bb44f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.324000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c41ba-fb8e-4ca8-9e5e-ce8bed5bb44f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.324280 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c41ba-fb8e-4ca8-9e5e-ce8bed5bb44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.355428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-756c41ba-fb8e-4ca8-9e5e-ce8bed5bb44f None None] MFA Rules not processed for user `5e2ef845120d4a2ea736581c3d198e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:15.356720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-756c41ba-fb8e-4ca8-9e5e-ce8bed5bb44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:15.409524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:15.431798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 940/1870] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:15.444144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d033e-3174-406b-b1b6-7dc841089c71 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:15.446694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6b8d033e-3174-406b-b1b6-7dc841089c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:15.536516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c41ba-fb8e-4ca8-9e5e-ce8bed5bb44f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:15.537964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-756c41ba-fb8e-4ca8-9e5e-ce8bed5bb44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:15.654318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d033e-3174-406b-b1b6-7dc841089c71 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:15.659234 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c41ba-fb8e-4ca8-9e5e-ce8bed5bb44f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:15.659865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ec522-797e-47ae-b56e-d446d037729c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:15.662155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ec522-797e-47ae-b56e-d446d037729c service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.662709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ec522-797e-47ae-b56e-d446d037729c service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.663653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ec522-797e-47ae-b56e-d446d037729c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.665484 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:15.666482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.666903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.667215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] PATH_INFO: `/v3/users/127f9efaccb84140b9c3d9526a598c81` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.668916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127f9efaccb84140b9c3d9526a598c81)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:15.671885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:15.679148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ec522-797e-47ae-b56e-d446d037729c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:15.680949 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ec522-797e-47ae-b56e-d446d037729c service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:15.709050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 931/1871] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:15.759677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127f9efaccb84140b9c3d9526a598c81'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:15.789621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127f9efaccb84140b9c3d9526a598c81'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:15.807838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127f9efaccb84140b9c3d9526a598c81'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:15.809329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127f9efaccb84140b9c3d9526a598c81'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:15.810181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127f9efaccb84140b9c3d9526a598c81'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:15.826217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 941/1872] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:15 2022] DELETE /identity/v3/users/127f9efaccb84140b9c3d9526a598c81 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:15.830777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d316d1-4c66-48ec-9e61-ef9f0f99fb50 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.831425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d316d1-4c66-48ec-9e61-ef9f0f99fb50 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.831425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d316d1-4c66-48ec-9e61-ef9f0f99fb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.852488 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:15.853947 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:15.862173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-90d316d1-4c66-48ec-9e61-ef9f0f99fb50 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:15.865373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-90d316d1-4c66-48ec-9e61-ef9f0f99fb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:15.933454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dee96a-f284-4547-ae86-782f31ccb3b5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:15.939371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:15.940471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:15.940757 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:15.941062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:15.944306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:15.953718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 932/1873] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:15.974909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d316d1-4c66-48ec-9e61-ef9f0f99fb50 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:15.976482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-90d316d1-4c66-48ec-9e61-ef9f0f99fb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:16.008005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:16.068712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:16.070431 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:16.079334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d316d1-4c66-48ec-9e61-ef9f0f99fb50 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:16.084100 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c124913-5c7a-46d3-9cef-92c69e6b2594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:16.085007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c124913-5c7a-46d3-9cef-92c69e6b2594 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:16.085290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c124913-5c7a-46d3-9cef-92c69e6b2594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:16.085611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c124913-5c7a-46d3-9cef-92c69e6b2594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:16.093743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 942/1874] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:16.106033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c124913-5c7a-46d3-9cef-92c69e6b2594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:16.108827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c124913-5c7a-46d3-9cef-92c69e6b2594 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:16.122309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 933/1875] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:16.876361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:16.877898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:16.904729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae02801-d261-4274-bdab-a03ff3a70b90 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:16.912456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:16.914066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:16.914356 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:16.914632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] PATH_INFO: `/v3/projects/0dd92511346e4c9eb843e0feff0c9207` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:16.924717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd92511346e4c9eb843e0feff0c9207)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:16.931787 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:16.998801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd92511346e4c9eb843e0feff0c9207', 'request_id': 'req-44250380-b30e-4dbf-934a-d0d29fe1808c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.014062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd92511346e4c9eb843e0feff0c9207', 'request_id': 'req-44250380-b30e-4dbf-934a-d0d29fe1808c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.025979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd92511346e4c9eb843e0feff0c9207', 'request_id': 'req-44250380-b30e-4dbf-934a-d0d29fe1808c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.043881 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] The token cache is being invalidate because project 0dd92511346e4c9eb843e0feff0c9207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:17.044421 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.045131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.047590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 943/1876] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:16 2022] DELETE /identity/v3/projects/0dd92511346e4c9eb843e0feff0c9207 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:17.051758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c124913-5c7a-46d3-9cef-92c69e6b2594 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:17.064814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c124913-5c7a-46d3-9cef-92c69e6b2594 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:17.087811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:17.202320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:17.206557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:17.206557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:17.206557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] PATH_INFO: `/v3/users/dc27aa820a5e40ad8d17408d098ee72c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:17.207781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc27aa820a5e40ad8d17408d098ee72c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:17.211722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:17.324842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc27aa820a5e40ad8d17408d098ee72c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.350799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc27aa820a5e40ad8d17408d098ee72c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.381557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc27aa820a5e40ad8d17408d098ee72c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.395399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc27aa820a5e40ad8d17408d098ee72c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.396472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb9bf77-9bec-4b64-9a66-41b340a46e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc27aa820a5e40ad8d17408d098ee72c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:17.409941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 934/1877] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:17 2022] DELETE /identity/v3/users/dc27aa820a5e40ad8d17408d098ee72c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:17.965371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:17.970540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:17.989879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44250380-b30e-4dbf-934a-d0d29fe1808c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:18.081186 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:18.082091 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.083062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.083455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] PATH_INFO: `/v3/projects/dbe02a509ab1477a8bbcdf9d5291ae65` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.084771 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe02a509ab1477a8bbcdf9d5291ae65)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:18.086919 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:18.158855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe02a509ab1477a8bbcdf9d5291ae65', 'request_id': 'req-60468dfd-bc5e-427d-b254-bbe981886faa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:18.160018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:18.171655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe02a509ab1477a8bbcdf9d5291ae65', 'request_id': 'req-60468dfd-bc5e-427d-b254-bbe981886faa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:18.180340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe02a509ab1477a8bbcdf9d5291ae65', 'request_id': 'req-60468dfd-bc5e-427d-b254-bbe981886faa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:18.197812 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] The token cache is being invalidate because project dbe02a509ab1477a8bbcdf9d5291ae65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:18.198262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:18.198980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60468dfd-bc5e-427d-b254-bbe981886faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:18.205945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 944/1878] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:17 2022] DELETE /identity/v3/projects/dbe02a509ab1477a8bbcdf9d5291ae65 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:18.208090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb38ecc-834b-4cc0-8666-8dfe87a26da8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.208569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb38ecc-834b-4cc0-8666-8dfe87a26da8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.208662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb38ecc-834b-4cc0-8666-8dfe87a26da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.234455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cdb38ecc-834b-4cc0-8666-8dfe87a26da8 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:18.235715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cdb38ecc-834b-4cc0-8666-8dfe87a26da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:18.354178 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 935/1879] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:18.361859 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5108fce-278c-4762-9c59-f31c958ef238 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.362441 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5108fce-278c-4762-9c59-f31c958ef238 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.362857 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5108fce-278c-4762-9c59-f31c958ef238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.393332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e5108fce-278c-4762-9c59-f31c958ef238 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:18.394696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5108fce-278c-4762-9c59-f31c958ef238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:18.410000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 945/1880] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:18.411544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb38ecc-834b-4cc0-8666-8dfe87a26da8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:18.430813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb38ecc-834b-4cc0-8666-8dfe87a26da8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:18.436555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569f51b-673c-4508-a544-40fcda583e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:18.437571 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f51b-673c-4508-a544-40fcda583e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.438020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f51b-673c-4508-a544-40fcda583e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.438461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f51b-673c-4508-a544-40fcda583e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.439351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569f51b-673c-4508-a544-40fcda583e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:14:18.439809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569f51b-673c-4508-a544-40fcda583e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:18.441723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569f51b-673c-4508-a544-40fcda583e86 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:18.458733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 936/1881] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:14:18.463392 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5108fce-278c-4762-9c59-f31c958ef238 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:18.474139 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5108fce-278c-4762-9c59-f31c958ef238 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:18.479149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d9556-2c93-4a83-a332-a01b5a64e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:18.479802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d9556-2c93-4a83-a332-a01b5a64e704 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.480086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d9556-2c93-4a83-a332-a01b5a64e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.480360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d9556-2c93-4a83-a332-a01b5a64e704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.481049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d9556-2c93-4a83-a332-a01b5a64e704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:18.482972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d9556-2c93-4a83-a332-a01b5a64e704 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:18.510603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 946/1882] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:18 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:14:18.514981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569f51b-673c-4508-a544-40fcda583e86 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:18.529524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569f51b-673c-4508-a544-40fcda583e86 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:18.553945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:18.594774 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4c148-5f6d-40a0-bd2f-f23ca03af4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:18.595450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4c148-5f6d-40a0-bd2f-f23ca03af4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.595736 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4c148-5f6d-40a0-bd2f-f23ca03af4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.596016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4c148-5f6d-40a0-bd2f-f23ca03af4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.596739 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4c148-5f6d-40a0-bd2f-f23ca03af4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:18.600003 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4c148-5f6d-40a0-bd2f-f23ca03af4d3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:18.627318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 937/1883] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:18 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:18.627423 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d9556-2c93-4a83-a332-a01b5a64e704 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:18.638797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d9556-2c93-4a83-a332-a01b5a64e704 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:18.644504 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3dc93-1297-4dc9-8a70-a09fccc65c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:18.645786 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3dc93-1297-4dc9-8a70-a09fccc65c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.646113 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3dc93-1297-4dc9-8a70-a09fccc65c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.646425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3dc93-1297-4dc9-8a70-a09fccc65c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.647184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3dc93-1297-4dc9-8a70-a09fccc65c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:18.649185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3dc93-1297-4dc9-8a70-a09fccc65c70 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:18.663642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 947/1884] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:18.668037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4c148-5f6d-40a0-bd2f-f23ca03af4d3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:18.678830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4c148-5f6d-40a0-bd2f-f23ca03af4d3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:18.683564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222a1c2-ef39-4fe7-acae-6d89a139b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:18.684232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222a1c2-ef39-4fe7-acae-6d89a139b10f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.684521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222a1c2-ef39-4fe7-acae-6d89a139b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.684805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222a1c2-ef39-4fe7-acae-6d89a139b10f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.685578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222a1c2-ef39-4fe7-acae-6d89a139b10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:18.687163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222a1c2-ef39-4fe7-acae-6d89a139b10f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:18.700586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 938/1885] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:14:18.701817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3dc93-1297-4dc9-8a70-a09fccc65c70 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:18.713828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3dc93-1297-4dc9-8a70-a09fccc65c70 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:18.721955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981576bc-539a-4088-bf46-91bce043b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:18.723525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981576bc-539a-4088-bf46-91bce043b765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.724101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981576bc-539a-4088-bf46-91bce043b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.725880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981576bc-539a-4088-bf46-91bce043b765 admin admin] PATH_INFO: `/v3/projects/95a56a9665594fe78c1c73b256f00d2f/users/063a87a7cada4d719c6098dbceaa3570/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.743034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981576bc-539a-4088-bf46-91bce043b765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a56a9665594fe78c1c73b256f00d2f, user_id=063a87a7cada4d719c6098dbceaa3570, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:18.745692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981576bc-539a-4088-bf46-91bce043b765 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:18.758882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 948/1886] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:18 2022] PUT /identity/v3/projects/95a56a9665594fe78c1c73b256f00d2f/users/063a87a7cada4d719c6098dbceaa3570/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:18.763911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950c0c-3184-47dc-8495-d66e62ef5be3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.764311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950c0c-3184-47dc-8495-d66e62ef5be3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.764702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950c0c-3184-47dc-8495-d66e62ef5be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.784546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9c950c0c-3184-47dc-8495-d66e62ef5be3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:18.786470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9c950c0c-3184-47dc-8495-d66e62ef5be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:18.847682 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 939/1887] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:18.857622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981576bc-539a-4088-bf46-91bce043b765 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:18.859313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-981576bc-539a-4088-bf46-91bce043b765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:18.920667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981576bc-539a-4088-bf46-91bce043b765 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:18.924349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec0f0e-1c29-4700-a9e6-32d24e710d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:18.925060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec0f0e-1c29-4700-a9e6-32d24e710d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:18.925620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec0f0e-1c29-4700-a9e6-32d24e710d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:18.925978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec0f0e-1c29-4700-a9e6-32d24e710d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:18.938861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec0f0e-1c29-4700-a9e6-32d24e710d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:18.940382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec0f0e-1c29-4700-a9e6-32d24e710d07 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:18.953364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 949/1888] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:20.067299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa30940-b8d5-454e-8658-ec600c365a6b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:20.068507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa30940-b8d5-454e-8658-ec600c365a6b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:20.068922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa30940-b8d5-454e-8658-ec600c365a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:20.098784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8aa30940-b8d5-454e-8658-ec600c365a6b None None] MFA Rules not processed for user `063a87a7cada4d719c6098dbceaa3570`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:20.100306 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8aa30940-b8d5-454e-8658-ec600c365a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:20.185601 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 940/1889] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:20.188130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec0f0e-1c29-4700-a9e6-32d24e710d07 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:20.201541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec0f0e-1c29-4700-a9e6-32d24e710d07 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:20.208634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff084d-896b-4c4a-a03c-2ca275bf3788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:20.209508 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff084d-896b-4c4a-a03c-2ca275bf3788 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:20.210009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff084d-896b-4c4a-a03c-2ca275bf3788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:20.210293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff084d-896b-4c4a-a03c-2ca275bf3788 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:20.211176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff084d-896b-4c4a-a03c-2ca275bf3788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:20.214105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff084d-896b-4c4a-a03c-2ca275bf3788 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:20.269131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 950/1890] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:20 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:20.271912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa30940-b8d5-454e-8658-ec600c365a6b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:20.295888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa30940-b8d5-454e-8658-ec600c365a6b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:20.338050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:20.376113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b22ce2-9528-4493-ae4d-72b1dd9fda7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:20.376806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22ce2-9528-4493-ae4d-72b1dd9fda7d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:20.377161 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22ce2-9528-4493-ae4d-72b1dd9fda7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:20.377501 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22ce2-9528-4493-ae4d-72b1dd9fda7d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:20.378250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b22ce2-9528-4493-ae4d-72b1dd9fda7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:20.381812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b22ce2-9528-4493-ae4d-72b1dd9fda7d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:20.409236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 941/1891] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:20 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:20.414750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff084d-896b-4c4a-a03c-2ca275bf3788 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:20.428420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff084d-896b-4c4a-a03c-2ca275bf3788 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:20.433733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f5e36-c3d5-478c-9300-2b7c79c89eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:20.434351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f5e36-c3d5-478c-9300-2b7c79c89eac admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:20.434702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f5e36-c3d5-478c-9300-2b7c79c89eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:20.435108 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f5e36-c3d5-478c-9300-2b7c79c89eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:20.435867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f5e36-c3d5-478c-9300-2b7c79c89eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:20.437773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f5e36-c3d5-478c-9300-2b7c79c89eac admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:20.452814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 951/1892] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:20.454496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b22ce2-9528-4493-ae4d-72b1dd9fda7d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:20.466443 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b22ce2-9528-4493-ae4d-72b1dd9fda7d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:20.472226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805550c-6562-4325-9925-51aecf9d781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:20.478259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805550c-6562-4325-9925-51aecf9d781e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:20.478259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805550c-6562-4325-9925-51aecf9d781e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:20.478259 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805550c-6562-4325-9925-51aecf9d781e admin admin] PATH_INFO: `/v3/projects/58127fb03be04415b3cf88dc0a4930ab/users/39a60264eeb34584bc444308aeb30cbb/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:20.492733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805550c-6562-4325-9925-51aecf9d781e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58127fb03be04415b3cf88dc0a4930ab, user_id=39a60264eeb34584bc444308aeb30cbb, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:20.495725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805550c-6562-4325-9925-51aecf9d781e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:20.511825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 942/1893] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:20 2022] PUT /identity/v3/projects/58127fb03be04415b3cf88dc0a4930ab/users/39a60264eeb34584bc444308aeb30cbb/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:20.519927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f5e36-c3d5-478c-9300-2b7c79c89eac admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:20.531013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f5e36-c3d5-478c-9300-2b7c79c89eac admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:20.585450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:20.605805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf98fe-77b2-428f-8859-3a7a7100a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:20.606523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf98fe-77b2-428f-8859-3a7a7100a0ef admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:20.606807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf98fe-77b2-428f-8859-3a7a7100a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:20.607135 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf98fe-77b2-428f-8859-3a7a7100a0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:20.607847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf98fe-77b2-428f-8859-3a7a7100a0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:20.609656 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf98fe-77b2-428f-8859-3a7a7100a0ef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:20.619924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 952/1894] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:20.624199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805550c-6562-4325-9925-51aecf9d781e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:20.635243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805550c-6562-4325-9925-51aecf9d781e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:20.640320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfefcab-e3df-42b9-9b47-bae682e3f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:20.641208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfefcab-e3df-42b9-9b47-bae682e3f741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:20.641583 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfefcab-e3df-42b9-9b47-bae682e3f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:20.641865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfefcab-e3df-42b9-9b47-bae682e3f741 admin admin] PATH_INFO: `/v3/projects/58127fb03be04415b3cf88dc0a4930ab/users/39a60264eeb34584bc444308aeb30cbb/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:20.643834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfefcab-e3df-42b9-9b47-bae682e3f741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58127fb03be04415b3cf88dc0a4930ab, user_id=39a60264eeb34584bc444308aeb30cbb, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:20.647036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfefcab-e3df-42b9-9b47-bae682e3f741 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:20.657544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 943/1895] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:20 2022] PUT /identity/v3/projects/58127fb03be04415b3cf88dc0a4930ab/users/39a60264eeb34584bc444308aeb30cbb/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:21.335541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf98fe-77b2-428f-8859-3a7a7100a0ef admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:21.337498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-97cf98fe-77b2-428f-8859-3a7a7100a0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:21.353098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf98fe-77b2-428f-8859-3a7a7100a0ef admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:21.437197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0cf2c-a689-46f9-ae74-bd5e2f85993b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:21.437612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0cf2c-a689-46f9-ae74-bd5e2f85993b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:21.437985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0cf2c-a689-46f9-ae74-bd5e2f85993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:21.501653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:21.504803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:21.504803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:21.508659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] PATH_INFO: `/v3/users/c1c9ecc3a61346faa00fc7d14121bacf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:21.516969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6eb0cf2c-a689-46f9-ae74-bd5e2f85993b None None] MFA Rules not processed for user `39a60264eeb34584bc444308aeb30cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:21.517418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c9ecc3a61346faa00fc7d14121bacf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:21.520689 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6eb0cf2c-a689-46f9-ae74-bd5e2f85993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:21.522394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:21.611125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c9ecc3a61346faa00fc7d14121bacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:21.630247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c9ecc3a61346faa00fc7d14121bacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:21.648122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c9ecc3a61346faa00fc7d14121bacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:21.660160 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c9ecc3a61346faa00fc7d14121bacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:21.662867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-86808cc1-e12a-4d94-a437-a38cc484dce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c9ecc3a61346faa00fc7d14121bacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:21.700213 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 953/1896] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:21 2022] DELETE /identity/v3/users/c1c9ecc3a61346faa00fc7d14121bacf => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:21.706069 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a541d4-9fdb-4ccf-9ec0-25363e1b6306 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:21.706355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a541d4-9fdb-4ccf-9ec0-25363e1b6306 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:21.706633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a541d4-9fdb-4ccf-9ec0-25363e1b6306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:21.717515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 944/1897] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:21.728163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0cf2c-a689-46f9-ae74-bd5e2f85993b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:21.729637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6eb0cf2c-a689-46f9-ae74-bd5e2f85993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:21.753672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8a541d4-9fdb-4ccf-9ec0-25363e1b6306 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:21.755269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8a541d4-9fdb-4ccf-9ec0-25363e1b6306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:21.815596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0cf2c-a689-46f9-ae74-bd5e2f85993b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:21.856703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:21.870428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:21.876681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 954/1898] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:21.930143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a14d-c201-4d05-b62f-a72776a28793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:21.930811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a14d-c201-4d05-b62f-a72776a28793 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:21.931190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a14d-c201-4d05-b62f-a72776a28793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:21.931367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a14d-c201-4d05-b62f-a72776a28793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:21.933234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6126a14d-c201-4d05-b62f-a72776a28793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:21.969907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a541d4-9fdb-4ccf-9ec0-25363e1b6306 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:21.972481 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8a541d4-9fdb-4ccf-9ec0-25363e1b6306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:22.021948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a14d-c201-4d05-b62f-a72776a28793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:22.023626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a14d-c201-4d05-b62f-a72776a28793 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:22.037529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 945/1899] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:22.086329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a541d4-9fdb-4ccf-9ec0-25363e1b6306 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:22.090018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0809b-6467-406d-b6d3-99f781883d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:22.090957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0809b-6467-406d-b6d3-99f781883d4b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:22.091248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0809b-6467-406d-b6d3-99f781883d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:22.091524 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0809b-6467-406d-b6d3-99f781883d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:22.102616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0809b-6467-406d-b6d3-99f781883d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:22.104290 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0809b-6467-406d-b6d3-99f781883d4b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:22.116079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 955/1900] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:23.598553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a14d-c201-4d05-b62f-a72776a28793 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:23.608461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a14d-c201-4d05-b62f-a72776a28793 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:23.613656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d26a7d-5866-467e-818f-9bad8c4775e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:23.614584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d26a7d-5866-467e-818f-9bad8c4775e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:23.615234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d26a7d-5866-467e-818f-9bad8c4775e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:23.615697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d26a7d-5866-467e-818f-9bad8c4775e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:23.703143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d26a7d-5866-467e-818f-9bad8c4775e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:23.708372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d26a7d-5866-467e-818f-9bad8c4775e3 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:23.713229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0809b-6467-406d-b6d3-99f781883d4b service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:23.715471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-32b0809b-6467-406d-b6d3-99f781883d4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:23.734142 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 946/1901] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:23.748613 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0809b-6467-406d-b6d3-99f781883d4b service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:23.770411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3bbaa-34f9-46cf-b809-c6d5db4bef60 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:23.771132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3bbaa-34f9-46cf-b809-c6d5db4bef60 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:23.771611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3bbaa-34f9-46cf-b809-c6d5db4bef60 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:23.773609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 947/1902] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:14:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:14:23.779055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:23.780197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:23.780478 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:23.780776 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] PATH_INFO: `/v3/projects/c3c373c261cc42359442d6e817b76e0c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:23.782219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c373c261cc42359442d6e817b76e0c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:23.788178 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:23.790023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76953916-93b8-4b17-a958-0753b270843d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:23.790333 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76953916-93b8-4b17-a958-0753b270843d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:23.790610 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76953916-93b8-4b17-a958-0753b270843d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:23.811863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-76953916-93b8-4b17-a958-0753b270843d None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:23.813890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76953916-93b8-4b17-a958-0753b270843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:23.906476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c373c261cc42359442d6e817b76e0c', 'request_id': 'req-a2e44daf-4f32-40fc-bb41-bb99c7168c80'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:23.908874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 948/1903] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:14:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:23.919426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c373c261cc42359442d6e817b76e0c', 'request_id': 'req-a2e44daf-4f32-40fc-bb41-bb99c7168c80'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:23.928982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c373c261cc42359442d6e817b76e0c', 'request_id': 'req-a2e44daf-4f32-40fc-bb41-bb99c7168c80'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:23.941879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76953916-93b8-4b17-a958-0753b270843d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:23.943504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76953916-93b8-4b17-a958-0753b270843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:23.956041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] The token cache is being invalidate because project c3c373c261cc42359442d6e817b76e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:23.956899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:23.959641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:23.963965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 956/1904] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:23 2022] DELETE /identity/v3/projects/c3c373c261cc42359442d6e817b76e0c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:23.965094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76953916-93b8-4b17-a958-0753b270843d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:23.967540 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:23.969114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:23.970397 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:24.098232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d09c-1be6-4156-b298-0553d22c2669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:24.105886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d09c-1be6-4156-b298-0553d22c2669 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:24.106602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d09c-1be6-4156-b298-0553d22c2669 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:24.106965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d09c-1be6-4156-b298-0553d22c2669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:24.116239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6553d09c-1be6-4156-b298-0553d22c2669 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:24.123070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e44daf-4f32-40fc-bb41-bb99c7168c80 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:24.128597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:24.130222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d09c-1be6-4156-b298-0553d22c2669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:24.130351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:24.130522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:24.130801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] PATH_INFO: `/v3/users/5e2ef845120d4a2ea736581c3d198e2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:24.131946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d09c-1be6-4156-b298-0553d22c2669 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:24.132068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2ef845120d4a2ea736581c3d198e2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:24.134028 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:24.142793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 949/1905] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:24.169672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:24.198497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2ef845120d4a2ea736581c3d198e2c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.220783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2ef845120d4a2ea736581c3d198e2c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.231406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2ef845120d4a2ea736581c3d198e2c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.232209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2ef845120d4a2ea736581c3d198e2c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.232988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1da45f00-7bb5-41b8-994c-d7126dac89a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2ef845120d4a2ea736581c3d198e2c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.250937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 957/1906] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:23 2022] DELETE /identity/v3/users/5e2ef845120d4a2ea736581c3d198e2c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:24.533181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d09c-1be6-4156-b298-0553d22c2669 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:24.545031 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d09c-1be6-4156-b298-0553d22c2669 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:24.609464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:24.610362 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:24.610651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:24.610931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] PATH_INFO: `/v3/projects/a8ac00c0545e4d78bc8a376b07d97f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:24.612147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ac00c0545e4d78bc8a376b07d97f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:24.615148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:24.668289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ac00c0545e4d78bc8a376b07d97f0a', 'request_id': 'req-dbc1229e-d286-4bc8-b34b-d4e038e5e800'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.679965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ac00c0545e4d78bc8a376b07d97f0a', 'request_id': 'req-dbc1229e-d286-4bc8-b34b-d4e038e5e800'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.690690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ac00c0545e4d78bc8a376b07d97f0a', 'request_id': 'req-dbc1229e-d286-4bc8-b34b-d4e038e5e800'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.715485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] The token cache is being invalidate because project a8ac00c0545e4d78bc8a376b07d97f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:24.715847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.719993 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dbc1229e-d286-4bc8-b34b-d4e038e5e800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:24.725505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 950/1907] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:24 2022] DELETE /identity/v3/projects/a8ac00c0545e4d78bc8a376b07d97f0a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:24.732526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100fa90-3042-4037-ae20-efe8c558b814 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:24.733155 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100fa90-3042-4037-ae20-efe8c558b814 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:24.733660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100fa90-3042-4037-ae20-efe8c558b814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:24.764244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3100fa90-3042-4037-ae20-efe8c558b814 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:24.765774 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3100fa90-3042-4037-ae20-efe8c558b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:24.870916 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 958/1908] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:24.878705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f173ede-b708-49dc-9a11-a43573841b48 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:24.879752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f173ede-b708-49dc-9a11-a43573841b48 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:24.880239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f173ede-b708-49dc-9a11-a43573841b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:24.900113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5f173ede-b708-49dc-9a11-a43573841b48 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:24.901312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5f173ede-b708-49dc-9a11-a43573841b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:24.909757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 951/1909] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:24.914749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100fa90-3042-4037-ae20-efe8c558b814 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:24.927656 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100fa90-3042-4037-ae20-efe8c558b814 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:24.933268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe19992-5026-4380-8bad-f205d81b1c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:24.933977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19992-5026-4380-8bad-f205d81b1c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:24.934263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19992-5026-4380-8bad-f205d81b1c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:24.934542 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19992-5026-4380-8bad-f205d81b1c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:24.935309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe19992-5026-4380-8bad-f205d81b1c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:14:24.935602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe19992-5026-4380-8bad-f205d81b1c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:24.937442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe19992-5026-4380-8bad-f205d81b1c2f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:24.952862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 959/1910] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:14:24.954000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f173ede-b708-49dc-9a11-a43573841b48 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:24.964524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f173ede-b708-49dc-9a11-a43573841b48 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:24.969842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6d3ef-6a26-487e-b892-b73cdfe8397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:24.970574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6d3ef-6a26-487e-b892-b73cdfe8397c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:24.970855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6d3ef-6a26-487e-b892-b73cdfe8397c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:24.971130 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6d3ef-6a26-487e-b892-b73cdfe8397c admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:24.971837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6d3ef-6a26-487e-b892-b73cdfe8397c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:24.974463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6d3ef-6a26-487e-b892-b73cdfe8397c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:24.990663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:25.005545 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 952/1911] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:24 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:25.009945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe19992-5026-4380-8bad-f205d81b1c2f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:25.021426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe19992-5026-4380-8bad-f205d81b1c2f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:25.100453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918bce-6c1e-4fa2-a35f-1fbd5974235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:25.101285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918bce-6c1e-4fa2-a35f-1fbd5974235f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:25.101767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918bce-6c1e-4fa2-a35f-1fbd5974235f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:25.102139 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918bce-6c1e-4fa2-a35f-1fbd5974235f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:25.103223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8918bce-6c1e-4fa2-a35f-1fbd5974235f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:25.105513 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8918bce-6c1e-4fa2-a35f-1fbd5974235f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:25.144575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 960/1912] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:25 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:25.146159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6d3ef-6a26-487e-b892-b73cdfe8397c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:25.160748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6d3ef-6a26-487e-b892-b73cdfe8397c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:25.183736 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289251f-4e6a-43a0-8184-2953e3eebf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:25.184937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289251f-4e6a-43a0-8184-2953e3eebf01 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:25.185203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289251f-4e6a-43a0-8184-2953e3eebf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:25.185547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289251f-4e6a-43a0-8184-2953e3eebf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:25.186691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289251f-4e6a-43a0-8184-2953e3eebf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:25.195324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289251f-4e6a-43a0-8184-2953e3eebf01 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:25.217569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 953/1913] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:25.223197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918bce-6c1e-4fa2-a35f-1fbd5974235f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:25.237068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918bce-6c1e-4fa2-a35f-1fbd5974235f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:25.243171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b96d2-de3d-4dac-8568-7e9e44ab0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:25.243852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b96d2-de3d-4dac-8568-7e9e44ab0a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:25.244140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b96d2-de3d-4dac-8568-7e9e44ab0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:25.244418 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b96d2-de3d-4dac-8568-7e9e44ab0a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:25.245677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b96d2-de3d-4dac-8568-7e9e44ab0a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:25.247349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b96d2-de3d-4dac-8568-7e9e44ab0a86 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:25.259085 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 961/1914] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:25.263420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289251f-4e6a-43a0-8184-2953e3eebf01 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:25.275506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289251f-4e6a-43a0-8184-2953e3eebf01 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:25.280364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397f6c-743b-44e1-8b3a-a683df56f797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:25.281356 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397f6c-743b-44e1-8b3a-a683df56f797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:25.281746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397f6c-743b-44e1-8b3a-a683df56f797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:25.282120 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397f6c-743b-44e1-8b3a-a683df56f797 admin admin] PATH_INFO: `/v3/projects/6b8aa6c1bef848329cc1775ce7ffd86f/users/1761ac0e3b7142b5a536a20da4889f57/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:25.297914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a397f6c-743b-44e1-8b3a-a683df56f797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8aa6c1bef848329cc1775ce7ffd86f, user_id=1761ac0e3b7142b5a536a20da4889f57, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:25.301386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a397f6c-743b-44e1-8b3a-a683df56f797 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:25.321455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 954/1915] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:25 2022] PUT /identity/v3/projects/6b8aa6c1bef848329cc1775ce7ffd86f/users/1761ac0e3b7142b5a536a20da4889f57/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:25.334833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cd2e9-b893-4b04-90cc-16b4665a024c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:25.335657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cd2e9-b893-4b04-90cc-16b4665a024c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:25.336892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cd2e9-b893-4b04-90cc-16b4665a024c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:25.370205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:25.382272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-971cd2e9-b893-4b04-90cc-16b4665a024c None None] MFA Rules not processed for user `1761ac0e3b7142b5a536a20da4889f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:25.388884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-971cd2e9-b893-4b04-90cc-16b4665a024c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:25.489937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 962/1916] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:25.501099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397f6c-743b-44e1-8b3a-a683df56f797 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:25.503187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3a397f6c-743b-44e1-8b3a-a683df56f797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:25.581800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397f6c-743b-44e1-8b3a-a683df56f797 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:25.587849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762b9d6-623a-4dec-b1bd-40ea16b25230 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ac2738bf434afabe3d227dc5e52650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:25.588507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762b9d6-623a-4dec-b1bd-40ea16b25230 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:25.588794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762b9d6-623a-4dec-b1bd-40ea16b25230 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:25.589080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762b9d6-623a-4dec-b1bd-40ea16b25230 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:25.597941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762b9d6-623a-4dec-b1bd-40ea16b25230 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:25.599352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762b9d6-623a-4dec-b1bd-40ea16b25230 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:25.608077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 955/1917] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:30.616223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cd2e9-b893-4b04-90cc-16b4665a024c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:30.617713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-971cd2e9-b893-4b04-90cc-16b4665a024c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:30.691142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cd2e9-b893-4b04-90cc-16b4665a024c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:30.696903 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:30.697862 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:30.698149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:30.698569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] PATH_INFO: `/v3/users/54ce64ebc3fc4e568973fe37a1c7b8f4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:30.699698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ce64ebc3fc4e568973fe37a1c7b8f4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:30.701674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:30.774159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ce64ebc3fc4e568973fe37a1c7b8f4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:30.792101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ce64ebc3fc4e568973fe37a1c7b8f4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:30.799982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ce64ebc3fc4e568973fe37a1c7b8f4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:30.801252 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ce64ebc3fc4e568973fe37a1c7b8f4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:30.801993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ce64ebc3fc4e568973fe37a1c7b8f4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:30.819869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 963/1918] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:30 2022] DELETE /identity/v3/users/54ce64ebc3fc4e568973fe37a1c7b8f4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:30.824569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca57f6-e214-45d7-a514-424662a8e6a3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:30.825689 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca57f6-e214-45d7-a514-424662a8e6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:30.826049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca57f6-e214-45d7-a514-424662a8e6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:30.854028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-21ca57f6-e214-45d7-a514-424662a8e6a3 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:30.855430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-21ca57f6-e214-45d7-a514-424662a8e6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:30.966567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 956/1919] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:30.983610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:30.985666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:31.020864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:31.063463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d4b86-c930-43c6-9462-66d3ace64c0d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:31.068593 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f490b-b5ce-4073-847e-90b84b64d479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:31.069337 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f490b-b5ce-4073-847e-90b84b64d479 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:31.069712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f490b-b5ce-4073-847e-90b84b64d479 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:31.070070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f490b-b5ce-4073-847e-90b84b64d479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:31.087560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f490b-b5ce-4073-847e-90b84b64d479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:31.089347 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f490b-b5ce-4073-847e-90b84b64d479 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:31.106774 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 964/1920] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:31.412029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca57f6-e214-45d7-a514-424662a8e6a3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:31.413859 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-21ca57f6-e214-45d7-a514-424662a8e6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:31.433505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca57f6-e214-45d7-a514-424662a8e6a3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:31.438321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:31.439485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:31.439974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:31.440395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] PATH_INFO: `/v3/projects/38621dc566bc4311950e061e73d2300d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:31.451437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38621dc566bc4311950e061e73d2300d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:31.453465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:31.532792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38621dc566bc4311950e061e73d2300d', 'request_id': 'req-2262d858-095b-41b3-9fd0-78a3dc8bba93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.542861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38621dc566bc4311950e061e73d2300d', 'request_id': 'req-2262d858-095b-41b3-9fd0-78a3dc8bba93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.544409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:31.551070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38621dc566bc4311950e061e73d2300d', 'request_id': 'req-2262d858-095b-41b3-9fd0-78a3dc8bba93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.564429 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] The token cache is being invalidate because project 38621dc566bc4311950e061e73d2300d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:31.564718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.565499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.567906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 957/1921] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:31 2022] DELETE /identity/v3/projects/38621dc566bc4311950e061e73d2300d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:31.572479 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f490b-b5ce-4073-847e-90b84b64d479 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:31.582272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f490b-b5ce-4073-847e-90b84b64d479 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:31.642040 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:31.643038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:31.643526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:31.643871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] PATH_INFO: `/v3/users/0e28615cc2ce428cbdda9f83499c5611` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:31.645307 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e28615cc2ce428cbdda9f83499c5611)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:31.647311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:31.695610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e28615cc2ce428cbdda9f83499c5611'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.707745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e28615cc2ce428cbdda9f83499c5611'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.714481 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e28615cc2ce428cbdda9f83499c5611'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.715202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e28615cc2ce428cbdda9f83499c5611'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.715797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2be3acf-47e1-407c-ad51-a613c0889fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e28615cc2ce428cbdda9f83499c5611'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:31.731378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 965/1922] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:31 2022] DELETE /identity/v3/users/0e28615cc2ce428cbdda9f83499c5611 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:32.380108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:32.381802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:32.400212 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262d858-095b-41b3-9fd0-78a3dc8bba93 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:32.477419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:32.478659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:32.479079 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:32.479588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] PATH_INFO: `/v3/projects/2f88556a91c54d27a2cea11e534ba51a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:32.483202 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f88556a91c54d27a2cea11e534ba51a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:32.485410 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:32.542232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f88556a91c54d27a2cea11e534ba51a', 'request_id': 'req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:32.550452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f88556a91c54d27a2cea11e534ba51a', 'request_id': 'req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:32.556199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f88556a91c54d27a2cea11e534ba51a', 'request_id': 'req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:32.568158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] The token cache is being invalidate because project 2f88556a91c54d27a2cea11e534ba51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:32.568447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:32.569672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e16dd88-e4d5-4d4f-ad3b-ff33ad7f84b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:32.570929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 958/1923] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:32 2022] DELETE /identity/v3/projects/2f88556a91c54d27a2cea11e534ba51a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:32.576808 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa779-5ed7-4a19-b730-b478854b2509 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:32.577098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa779-5ed7-4a19-b730-b478854b2509 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:32.577412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefa779-5ed7-4a19-b730-b478854b2509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:32.595765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-afefa779-5ed7-4a19-b730-b478854b2509 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:32.597000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-afefa779-5ed7-4a19-b730-b478854b2509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:32.641631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:32.676203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 966/1924] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:32.679607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa4075-9e79-4df4-8a23-9fa999662dfd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:32.679899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa4075-9e79-4df4-8a23-9fa999662dfd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:32.680173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa4075-9e79-4df4-8a23-9fa999662dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:32.701350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e6aa4075-9e79-4df4-8a23-9fa999662dfd None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:32.702350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e6aa4075-9e79-4df4-8a23-9fa999662dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:32.713437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 959/1925] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:32.717840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefa779-5ed7-4a19-b730-b478854b2509 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:32.731192 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefa779-5ed7-4a19-b730-b478854b2509 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:32.735971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eaac0-2db0-4c81-a334-3532512ba74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:32.736647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eaac0-2db0-4c81-a334-3532512ba74e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:32.736938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eaac0-2db0-4c81-a334-3532512ba74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:32.737218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eaac0-2db0-4c81-a334-3532512ba74e admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:32.738042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39eaac0-2db0-4c81-a334-3532512ba74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:14:32.738366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39eaac0-2db0-4c81-a334-3532512ba74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:32.739982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39eaac0-2db0-4c81-a334-3532512ba74e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:32.752760 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 967/1926] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:14:32.759003 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa4075-9e79-4df4-8a23-9fa999662dfd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:32.772234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa4075-9e79-4df4-8a23-9fa999662dfd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:32.779401 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e2df-a071-438e-9a66-8d29d7d61556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:32.780099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e2df-a071-438e-9a66-8d29d7d61556 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:32.780387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e2df-a071-438e-9a66-8d29d7d61556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:32.780696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e2df-a071-438e-9a66-8d29d7d61556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:32.781587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e2df-a071-438e-9a66-8d29d7d61556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:32.783728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e2df-a071-438e-9a66-8d29d7d61556 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:32.812331 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 960/1927] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:32 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:32.816620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eaac0-2db0-4c81-a334-3532512ba74e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:32.826786 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eaac0-2db0-4c81-a334-3532512ba74e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:32.885013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe3123-464b-4aaa-b233-ebf2d955c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:32.885714 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3123-464b-4aaa-b233-ebf2d955c55d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:32.886006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3123-464b-4aaa-b233-ebf2d955c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:32.886286 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe3123-464b-4aaa-b233-ebf2d955c55d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:32.886980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe3123-464b-4aaa-b233-ebf2d955c55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:32.888887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe3123-464b-4aaa-b233-ebf2d955c55d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:32.911315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 968/1928] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:32 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:32.915196 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e2df-a071-438e-9a66-8d29d7d61556 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:32.927633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e2df-a071-438e-9a66-8d29d7d61556 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:32.932885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef9907-4d88-4314-9939-91065746db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:32.933586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef9907-4d88-4314-9939-91065746db4f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:32.933877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef9907-4d88-4314-9939-91065746db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:32.934160 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef9907-4d88-4314-9939-91065746db4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:32.935223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef9907-4d88-4314-9939-91065746db4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:32.936508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef9907-4d88-4314-9939-91065746db4f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:32.948405 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 961/1929] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:32.952369 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe3123-464b-4aaa-b233-ebf2d955c55d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:32.963946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe3123-464b-4aaa-b233-ebf2d955c55d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:32.968736 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479554d-32f5-4b46-9361-17c565883dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:32.969411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479554d-32f5-4b46-9361-17c565883dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:32.969732 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479554d-32f5-4b46-9361-17c565883dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:32.970015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479554d-32f5-4b46-9361-17c565883dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:32.970752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479554d-32f5-4b46-9361-17c565883dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:32.972360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479554d-32f5-4b46-9361-17c565883dc4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:32.986096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 969/1930] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:32.990792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef9907-4d88-4314-9939-91065746db4f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:33.000821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef9907-4d88-4314-9939-91065746db4f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:33.006292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cab93-4221-40dd-9c9e-1d671e700001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:33.007185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cab93-4221-40dd-9c9e-1d671e700001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.007491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cab93-4221-40dd-9c9e-1d671e700001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.007756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cab93-4221-40dd-9c9e-1d671e700001 admin admin] PATH_INFO: `/v3/projects/15f226d7907f4b0581eb08ec7f90719c/users/31b439bcec8d4bdc89d2af054e99bb33/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.024338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cab93-4221-40dd-9c9e-1d671e700001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f226d7907f4b0581eb08ec7f90719c, user_id=31b439bcec8d4bdc89d2af054e99bb33, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:33.027017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cab93-4221-40dd-9c9e-1d671e700001 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:33.046758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 962/1931] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:32 2022] PUT /identity/v3/projects/15f226d7907f4b0581eb08ec7f90719c/users/31b439bcec8d4bdc89d2af054e99bb33/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:33.057958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a96d-fc98-4cee-b3b2-43c9bc6a890f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.058300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a96d-fc98-4cee-b3b2-43c9bc6a890f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.058525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a96d-fc98-4cee-b3b2-43c9bc6a890f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.090703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9167a96d-fc98-4cee-b3b2-43c9bc6a890f None None] MFA Rules not processed for user `31b439bcec8d4bdc89d2af054e99bb33`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:33.092016 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9167a96d-fc98-4cee-b3b2-43c9bc6a890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:33.161591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 970/1932] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:33.168514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cab93-4221-40dd-9c9e-1d671e700001 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:33.181762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:33.241201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cab93-4221-40dd-9c9e-1d671e700001 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:33.245904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374e7e7-4808-4aa3-9124-626414910d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:33.246591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e7e7-4808-4aa3-9124-626414910d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.246874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e7e7-4808-4aa3-9124-626414910d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.247270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374e7e7-4808-4aa3-9124-626414910d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.248096 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374e7e7-4808-4aa3-9124-626414910d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:33.250134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374e7e7-4808-4aa3-9124-626414910d0c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:33.286457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 963/1933] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:33 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:33.290701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a96d-fc98-4cee-b3b2-43c9bc6a890f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:33.302301 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a96d-fc98-4cee-b3b2-43c9bc6a890f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:33.340238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:33.374753 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad6894-cf9d-41e5-823c-7f3edd6cd89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:33.375204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad6894-cf9d-41e5-823c-7f3edd6cd89d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.375589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad6894-cf9d-41e5-823c-7f3edd6cd89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.375995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad6894-cf9d-41e5-823c-7f3edd6cd89d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.376854 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad6894-cf9d-41e5-823c-7f3edd6cd89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:33.379584 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad6894-cf9d-41e5-823c-7f3edd6cd89d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:33.405661 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 971/1934] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:33 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:33.409562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374e7e7-4808-4aa3-9124-626414910d0c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:33.423956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374e7e7-4808-4aa3-9124-626414910d0c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:33.429860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd45d8-d4c1-4c68-8d1e-9dc66b2427c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:33.430535 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd45d8-d4c1-4c68-8d1e-9dc66b2427c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.430824 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd45d8-d4c1-4c68-8d1e-9dc66b2427c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.431112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd45d8-d4c1-4c68-8d1e-9dc66b2427c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.431878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd45d8-d4c1-4c68-8d1e-9dc66b2427c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:33.433584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd45d8-d4c1-4c68-8d1e-9dc66b2427c9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:33.446211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 964/1935] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:14:33.450690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad6894-cf9d-41e5-823c-7f3edd6cd89d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:33.463737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad6894-cf9d-41e5-823c-7f3edd6cd89d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:33.468905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3982f-09e6-4c07-bf4f-0571b7306b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:33.469620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3982f-09e6-4c07-bf4f-0571b7306b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.469914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3982f-09e6-4c07-bf4f-0571b7306b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.470194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3982f-09e6-4c07-bf4f-0571b7306b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.470930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3982f-09e6-4c07-bf4f-0571b7306b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:33.472953 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3982f-09e6-4c07-bf4f-0571b7306b45 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:33.486820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 972/1936] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:33.491948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd45d8-d4c1-4c68-8d1e-9dc66b2427c9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:33.502872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd45d8-d4c1-4c68-8d1e-9dc66b2427c9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:33.509194 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5a98d-721e-4db9-9e31-19f680865456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:33.511536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5a98d-721e-4db9-9e31-19f680865456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.511825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5a98d-721e-4db9-9e31-19f680865456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.512103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5a98d-721e-4db9-9e31-19f680865456 admin admin] PATH_INFO: `/v3/projects/4ecca3fd31364f90841762e74822bfa8/users/16dabd50f36e496ab5bd3e10aad08147/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.533857 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5a98d-721e-4db9-9e31-19f680865456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecca3fd31364f90841762e74822bfa8, user_id=16dabd50f36e496ab5bd3e10aad08147, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:33.537346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5a98d-721e-4db9-9e31-19f680865456 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:33.554905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 965/1937] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:33 2022] PUT /identity/v3/projects/4ecca3fd31364f90841762e74822bfa8/users/16dabd50f36e496ab5bd3e10aad08147/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:33.565855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574d7a-50dc-493f-ae12-eff9bf644f3c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.566852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574d7a-50dc-493f-ae12-eff9bf644f3c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.567450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574d7a-50dc-493f-ae12-eff9bf644f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.598550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e4574d7a-50dc-493f-ae12-eff9bf644f3c None None] MFA Rules not processed for user `16dabd50f36e496ab5bd3e10aad08147`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:33.600043 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e4574d7a-50dc-493f-ae12-eff9bf644f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:33.696484 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 973/1938] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:33.700920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5a98d-721e-4db9-9e31-19f680865456 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:33.792136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5a98d-721e-4db9-9e31-19f680865456 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:33.798586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e8fe3-94d7-4a72-aa00-93e3774b42a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:33.799271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e8fe3-94d7-4a72-aa00-93e3774b42a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.799683 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e8fe3-94d7-4a72-aa00-93e3774b42a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.799971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e8fe3-94d7-4a72-aa00-93e3774b42a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.801262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e8fe3-94d7-4a72-aa00-93e3774b42a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:33.803363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e8fe3-94d7-4a72-aa00-93e3774b42a4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:33.839243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 966/1939] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:33 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:33.839579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4574d7a-50dc-493f-ae12-eff9bf644f3c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:33.857865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4574d7a-50dc-493f-ae12-eff9bf644f3c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:33.931379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb50695-9934-421f-b4c4-5cf172724f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:33.932263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb50695-9934-421f-b4c4-5cf172724f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.932537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb50695-9934-421f-b4c4-5cf172724f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.932924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb50695-9934-421f-b4c4-5cf172724f55 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.933959 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb50695-9934-421f-b4c4-5cf172724f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:33.936114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb50695-9934-421f-b4c4-5cf172724f55 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:33.959592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 974/1940] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:33 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:33.960899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e8fe3-94d7-4a72-aa00-93e3774b42a4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:33.971925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e8fe3-94d7-4a72-aa00-93e3774b42a4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:33.977633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738c6b8-ea6c-4d36-898a-7cd880a3ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:33.978377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738c6b8-ea6c-4d36-898a-7cd880a3ffd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:33.978673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738c6b8-ea6c-4d36-898a-7cd880a3ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:33.978962 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738c6b8-ea6c-4d36-898a-7cd880a3ffd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:33.979699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738c6b8-ea6c-4d36-898a-7cd880a3ffd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:33.981303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738c6b8-ea6c-4d36-898a-7cd880a3ffd7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:33.993270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 967/1941] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:33.997485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb50695-9934-421f-b4c4-5cf172724f55 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:34.008751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb50695-9934-421f-b4c4-5cf172724f55 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:34.013535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5043b2-f0d6-4af5-a79a-1fe5e5efaeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:34.014376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5043b2-f0d6-4af5-a79a-1fe5e5efaeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:34.014792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5043b2-f0d6-4af5-a79a-1fe5e5efaeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:34.015070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5043b2-f0d6-4af5-a79a-1fe5e5efaeeb admin admin] PATH_INFO: `/v3/projects/10e2b5b1a76641efa14968f11fd10f27/users/0b14a09b708f4eed9764b197327772ee/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:34.029893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5043b2-f0d6-4af5-a79a-1fe5e5efaeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e2b5b1a76641efa14968f11fd10f27, user_id=0b14a09b708f4eed9764b197327772ee, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:34.032977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5043b2-f0d6-4af5-a79a-1fe5e5efaeeb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:34.048257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 975/1942] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:33 2022] PUT /identity/v3/projects/10e2b5b1a76641efa14968f11fd10f27/users/0b14a09b708f4eed9764b197327772ee/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:34.052866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738c6b8-ea6c-4d36-898a-7cd880a3ffd7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:34.062982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738c6b8-ea6c-4d36-898a-7cd880a3ffd7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:34.094639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:34.122830 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c00953-fadd-40c6-8439-635cb3cb8798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:34.123506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c00953-fadd-40c6-8439-635cb3cb8798 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:34.123790 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c00953-fadd-40c6-8439-635cb3cb8798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:34.124100 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c00953-fadd-40c6-8439-635cb3cb8798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:34.124827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c00953-fadd-40c6-8439-635cb3cb8798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:34.126470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c00953-fadd-40c6-8439-635cb3cb8798 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:34.137352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 968/1943] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:34.141702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5043b2-f0d6-4af5-a79a-1fe5e5efaeeb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:34.154947 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5043b2-f0d6-4af5-a79a-1fe5e5efaeeb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:34.160386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69584c-e980-4821-949b-4c09e07ca867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:34.161619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69584c-e980-4821-949b-4c09e07ca867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:34.161902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69584c-e980-4821-949b-4c09e07ca867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:34.162178 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69584c-e980-4821-949b-4c09e07ca867 admin admin] PATH_INFO: `/v3/projects/10e2b5b1a76641efa14968f11fd10f27/users/0b14a09b708f4eed9764b197327772ee/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:34.164130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69584c-e980-4821-949b-4c09e07ca867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e2b5b1a76641efa14968f11fd10f27, user_id=0b14a09b708f4eed9764b197327772ee, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:34.166793 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69584c-e980-4821-949b-4c09e07ca867 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:34.172585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:34.180417 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 976/1944] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:34 2022] PUT /identity/v3/projects/10e2b5b1a76641efa14968f11fd10f27/users/0b14a09b708f4eed9764b197327772ee/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:34.190698 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8755261-0e1b-4c07-921f-5aafa0b9237a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:34.191061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8755261-0e1b-4c07-921f-5aafa0b9237a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:34.191440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8755261-0e1b-4c07-921f-5aafa0b9237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:34.220424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d8755261-0e1b-4c07-921f-5aafa0b9237a None None] MFA Rules not processed for user `0b14a09b708f4eed9764b197327772ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:34.221787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d8755261-0e1b-4c07-921f-5aafa0b9237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:34.311468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 969/1945] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:34.325818 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69584c-e980-4821-949b-4c09e07ca867 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:34.327562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9e69584c-e980-4821-949b-4c09e07ca867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:34.404905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69584c-e980-4821-949b-4c09e07ca867 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:34.411013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62892ea-1691-4fc0-a959-8cc90c660591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:34.411683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62892ea-1691-4fc0-a959-8cc90c660591 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:34.411969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62892ea-1691-4fc0-a959-8cc90c660591 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:34.412248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62892ea-1691-4fc0-a959-8cc90c660591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:34.424383 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62892ea-1691-4fc0-a959-8cc90c660591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:34.426554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62892ea-1691-4fc0-a959-8cc90c660591 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:34.444398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 977/1946] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:34.490876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8755261-0e1b-4c07-921f-5aafa0b9237a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:34.492267 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d8755261-0e1b-4c07-921f-5aafa0b9237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:34.505035 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8755261-0e1b-4c07-921f-5aafa0b9237a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:34.508606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3ff9e-88cd-43dd-96ec-84e6caf50b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:34.509256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3ff9e-88cd-43dd-96ec-84e6caf50b53 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:34.509566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3ff9e-88cd-43dd-96ec-84e6caf50b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:34.509845 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3ff9e-88cd-43dd-96ec-84e6caf50b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:34.583219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3ff9e-88cd-43dd-96ec-84e6caf50b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:34.584596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3ff9e-88cd-43dd-96ec-84e6caf50b53 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:34.602833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 970/1947] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:38.658902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62892ea-1691-4fc0-a959-8cc90c660591 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:38.758023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62892ea-1691-4fc0-a959-8cc90c660591 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:38.765531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:38.767075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:38.767527 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:38.767941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] PATH_INFO: `/v3/users/31b439bcec8d4bdc89d2af054e99bb33` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:38.770327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b439bcec8d4bdc89d2af054e99bb33)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:38.772720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:38.851820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b439bcec8d4bdc89d2af054e99bb33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:38.872863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b439bcec8d4bdc89d2af054e99bb33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:38.888548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b439bcec8d4bdc89d2af054e99bb33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:38.889321 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b439bcec8d4bdc89d2af054e99bb33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:38.890474 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b439bcec8d4bdc89d2af054e99bb33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:38.911788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 978/1948] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:38 2022] DELETE /identity/v3/users/31b439bcec8d4bdc89d2af054e99bb33 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:38.916375 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6ca45-791b-4719-ab2e-62db8f3e729c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:38.917462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6ca45-791b-4719-ab2e-62db8f3e729c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:38.918043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6ca45-791b-4719-ab2e-62db8f3e729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:38.937030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f0d6ca45-791b-4719-ab2e-62db8f3e729c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:38.938506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f0d6ca45-791b-4719-ab2e-62db8f3e729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:38.995687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:39.009920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 971/1949] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:39.026178 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:39.027660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:39.055283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:39.099686 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d3d49-bc6d-4cf7-a71e-96780bff4487 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:39.103571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb0437-2a67-49e3-af97-5b9f4d0d7a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:39.104333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb0437-2a67-49e3-af97-5b9f4d0d7a28 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:39.104740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb0437-2a67-49e3-af97-5b9f4d0d7a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:39.105046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb0437-2a67-49e3-af97-5b9f4d0d7a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:39.118189 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb0437-2a67-49e3-af97-5b9f4d0d7a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:39.121041 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb0437-2a67-49e3-af97-5b9f4d0d7a28 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:39.138015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 979/1950] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:39.402767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6ca45-791b-4719-ab2e-62db8f3e729c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:39.404228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f0d6ca45-791b-4719-ab2e-62db8f3e729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:39.418103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6ca45-791b-4719-ab2e-62db8f3e729c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:39.423537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:39.424735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:39.425094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:39.425516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] PATH_INFO: `/v3/users/063a87a7cada4d719c6098dbceaa3570` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:39.427365 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] RBAC: Authorizing `identity:delete_user(user_id=063a87a7cada4d719c6098dbceaa3570)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:39.429568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:39.530786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063a87a7cada4d719c6098dbceaa3570'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:39.550086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063a87a7cada4d719c6098dbceaa3570'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:39.560241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063a87a7cada4d719c6098dbceaa3570'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:39.569977 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063a87a7cada4d719c6098dbceaa3570'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:39.570721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063a87a7cada4d719c6098dbceaa3570'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:39.581165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 972/1951] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:39 2022] DELETE /identity/v3/users/063a87a7cada4d719c6098dbceaa3570 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:39.814314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb0437-2a67-49e3-af97-5b9f4d0d7a28 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:39.818565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45bb0437-2a67-49e3-af97-5b9f4d0d7a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:39.844505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb0437-2a67-49e3-af97-5b9f4d0d7a28 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:39.936420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:39.937325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:39.937666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:39.937952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] PATH_INFO: `/v3/projects/15f226d7907f4b0581eb08ec7f90719c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:39.939239 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f226d7907f4b0581eb08ec7f90719c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:39.941895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:40.026498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f226d7907f4b0581eb08ec7f90719c', 'request_id': 'req-17c469fa-1323-46b0-8ecf-5854cc1c6506'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.033631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f226d7907f4b0581eb08ec7f90719c', 'request_id': 'req-17c469fa-1323-46b0-8ecf-5854cc1c6506'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.056729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f226d7907f4b0581eb08ec7f90719c', 'request_id': 'req-17c469fa-1323-46b0-8ecf-5854cc1c6506'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.061870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:40.064625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:40.079788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962d127-2d23-4899-82e6-a4a513ce584c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:40.088243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] The token cache is being invalidate because project 15f226d7907f4b0581eb08ec7f90719c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:40.088928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.089926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.096582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 980/1952] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:39 2022] DELETE /identity/v3/projects/15f226d7907f4b0581eb08ec7f90719c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:40.100806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:40.114949 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:40.162603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:40.163493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:40.163779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:40.164058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] PATH_INFO: `/v3/projects/95a56a9665594fe78c1c73b256f00d2f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:40.167004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a56a9665594fe78c1c73b256f00d2f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:40.168854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:40.192437 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:40.216247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c469fa-1323-46b0-8ecf-5854cc1c6506 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:40.229994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a56a9665594fe78c1c73b256f00d2f', 'request_id': 'req-5979fe2c-7096-4ed3-a25e-4fe274c5f452'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.240289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a56a9665594fe78c1c73b256f00d2f', 'request_id': 'req-5979fe2c-7096-4ed3-a25e-4fe274c5f452'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.247630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a56a9665594fe78c1c73b256f00d2f', 'request_id': 'req-5979fe2c-7096-4ed3-a25e-4fe274c5f452'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.258363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:40.264919 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] The token cache is being invalidate because project 95a56a9665594fe78c1c73b256f00d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:40.265841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.266665 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.268832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 973/1953] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:40 2022] DELETE /identity/v3/projects/95a56a9665594fe78c1c73b256f00d2f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:40.272606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:40.274959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:40.296933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:40.297866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:40.298521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:40.298521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] PATH_INFO: `/v3/users/16dabd50f36e496ab5bd3e10aad08147` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:40.299683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dabd50f36e496ab5bd3e10aad08147)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:40.302272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:40.352859 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979fe2c-7096-4ed3-a25e-4fe274c5f452 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:40.357673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:40.358569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:40.358854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:40.358966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dabd50f36e496ab5bd3e10aad08147'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.359127 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] PATH_INFO: `/v3/users/39a60264eeb34584bc444308aeb30cbb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:40.360373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a60264eeb34584bc444308aeb30cbb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:40.362392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:40.374084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dabd50f36e496ab5bd3e10aad08147'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.387727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dabd50f36e496ab5bd3e10aad08147'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.388608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dabd50f36e496ab5bd3e10aad08147'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.389263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dabd50f36e496ab5bd3e10aad08147'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.405071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 981/1954] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:40 2022] DELETE /identity/v3/users/16dabd50f36e496ab5bd3e10aad08147 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:40.421129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a60264eeb34584bc444308aeb30cbb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.436211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a60264eeb34584bc444308aeb30cbb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.446005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a60264eeb34584bc444308aeb30cbb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.456018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a60264eeb34584bc444308aeb30cbb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.458077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a60264eeb34584bc444308aeb30cbb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:40.468481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 974/1955] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:40 2022] DELETE /identity/v3/users/39a60264eeb34584bc444308aeb30cbb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:40.790806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:40.792588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:40.876514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:40.879989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969faa42-ec9d-4a14-822f-4f0b9063a0df admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:40.881077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:40.926991 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:41.013522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.014422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.014743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.015024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] PATH_INFO: `/v3/projects/58127fb03be04415b3cf88dc0a4930ab` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.016314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58127fb03be04415b3cf88dc0a4930ab)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.016810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a7ea-b629-4f35-8af7-5b69cf92a000 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:41.018272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.022648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.025451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.026468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.027309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] PATH_INFO: `/v3/projects/4ecca3fd31364f90841762e74822bfa8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.028445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ecca3fd31364f90841762e74822bfa8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.030568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.081280 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:41.116729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58127fb03be04415b3cf88dc0a4930ab', 'request_id': 'req-1d1bab61-0776-4352-830d-0239df581e1f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.124120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58127fb03be04415b3cf88dc0a4930ab', 'request_id': 'req-1d1bab61-0776-4352-830d-0239df581e1f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.129753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ecca3fd31364f90841762e74822bfa8', 'request_id': 'req-89224e8e-b35d-428f-810d-a31542131f77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.135373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58127fb03be04415b3cf88dc0a4930ab', 'request_id': 'req-1d1bab61-0776-4352-830d-0239df581e1f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.142457 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ecca3fd31364f90841762e74822bfa8', 'request_id': 'req-89224e8e-b35d-428f-810d-a31542131f77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.156509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ecca3fd31364f90841762e74822bfa8', 'request_id': 'req-89224e8e-b35d-428f-810d-a31542131f77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.158565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] The token cache is being invalidate because project 58127fb03be04415b3cf88dc0a4930ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:41.159009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.159649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1d1bab61-0776-4352-830d-0239df581e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.162803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 982/1956] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:40 2022] DELETE /identity/v3/projects/58127fb03be04415b3cf88dc0a4930ab => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:41.170914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42881bc-fe6f-4322-a17d-58c213ab44e0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.171432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42881bc-fe6f-4322-a17d-58c213ab44e0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.172038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42881bc-fe6f-4322-a17d-58c213ab44e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.173330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] The token cache is being invalidate because project 4ecca3fd31364f90841762e74822bfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:41.173831 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.174646 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.177556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 975/1957] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:40 2022] DELETE /identity/v3/projects/4ecca3fd31364f90841762e74822bfa8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:41.182361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:41.184522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:41.195336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e42881bc-fe6f-4322-a17d-58c213ab44e0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:41.196649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e42881bc-fe6f-4322-a17d-58c213ab44e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:41.278081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89224e8e-b35d-428f-810d-a31542131f77 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:41.284282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.285887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.286177 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.286500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] PATH_INFO: `/v3/users/0b14a09b708f4eed9764b197327772ee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.287802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b14a09b708f4eed9764b197327772ee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.290190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.299338 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 983/1958] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:41.308450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506df3f-7e82-4ab5-a8cf-26cf45dbc58c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.308911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506df3f-7e82-4ab5-a8cf-26cf45dbc58c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.309344 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506df3f-7e82-4ab5-a8cf-26cf45dbc58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.338012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8506df3f-7e82-4ab5-a8cf-26cf45dbc58c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:41.339384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8506df3f-7e82-4ab5-a8cf-26cf45dbc58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:41.352453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 984/1959] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:41.355715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506df3f-7e82-4ab5-a8cf-26cf45dbc58c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:41.369765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b14a09b708f4eed9764b197327772ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.372280 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506df3f-7e82-4ab5-a8cf-26cf45dbc58c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:41.379638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.380741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.381250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.381784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.382557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:14:41.382872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.384480 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b14a09b708f4eed9764b197327772ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.384618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.394729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b14a09b708f4eed9764b197327772ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.405167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b14a09b708f4eed9764b197327772ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.405724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 985/1960] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:14:41.406283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b14a09b708f4eed9764b197327772ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.406702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:41.408838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:41.414645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 976/1961] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:41 2022] DELETE /identity/v3/users/0b14a09b708f4eed9764b197327772ee => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:41.424624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640b137-9342-4ae0-949e-b81752afa7ad admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:41.471708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:41.520375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b08c88-d5f4-4804-b66f-b909f82b9bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.521031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08c88-d5f4-4804-b66f-b909f82b9bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.521318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08c88-d5f4-4804-b66f-b909f82b9bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.521633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08c88-d5f4-4804-b66f-b909f82b9bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.522340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b08c88-d5f4-4804-b66f-b909f82b9bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.524494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b08c88-d5f4-4804-b66f-b909f82b9bfd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.574545 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:41.575070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 986/1962] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:41 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:41.587856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8914a-5f81-4e13-96e0-f66278d34244 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:41.637813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:41.680288 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83706bad-1361-4181-be73-f29d31ba5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.680991 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83706bad-1361-4181-be73-f29d31ba5d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.681281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83706bad-1361-4181-be73-f29d31ba5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.681589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83706bad-1361-4181-be73-f29d31ba5d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.682298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83706bad-1361-4181-be73-f29d31ba5d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.684243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83706bad-1361-4181-be73-f29d31ba5d0e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.723718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 977/1963] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:41 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:14:41.728504 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b08c88-d5f4-4804-b66f-b909f82b9bfd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:41.745766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b08c88-d5f4-4804-b66f-b909f82b9bfd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:41.762669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86e593-5ea0-4d8a-b93d-20ad348acd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.763611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e593-5ea0-4d8a-b93d-20ad348acd51 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.764045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e593-5ea0-4d8a-b93d-20ad348acd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.764470 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e593-5ea0-4d8a-b93d-20ad348acd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.765887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86e593-5ea0-4d8a-b93d-20ad348acd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.768275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86e593-5ea0-4d8a-b93d-20ad348acd51 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.791420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 987/1964] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:41.793048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83706bad-1361-4181-be73-f29d31ba5d0e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:41.808439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83706bad-1361-4181-be73-f29d31ba5d0e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:41.810929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86e593-5ea0-4d8a-b93d-20ad348acd51 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:41.812928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f86e593-5ea0-4d8a-b93d-20ad348acd51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:41.822077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff5ae7-86d5-4a57-ae42-0c61a09cb42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.823555 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5ae7-86d5-4a57-ae42-0c61a09cb42a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.824596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5ae7-86d5-4a57-ae42-0c61a09cb42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.825100 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5ae7-86d5-4a57-ae42-0c61a09cb42a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.828320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff5ae7-86d5-4a57-ae42-0c61a09cb42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.833248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff5ae7-86d5-4a57-ae42-0c61a09cb42a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.843552 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86e593-5ea0-4d8a-b93d-20ad348acd51 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:41.854445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 978/1965] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:41.854766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.855437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff5ae7-86d5-4a57-ae42-0c61a09cb42a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:41.855681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.855970 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.856252 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] PATH_INFO: `/v3/projects/10e2b5b1a76641efa14968f11fd10f27` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.857943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e2b5b1a76641efa14968f11fd10f27)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.860127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.869854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff5ae7-86d5-4a57-ae42-0c61a09cb42a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:41.875378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1c903-f377-4986-a1ea-5b70b59b6720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:41.876568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1c903-f377-4986-a1ea-5b70b59b6720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.876847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1c903-f377-4986-a1ea-5b70b59b6720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.877257 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1c903-f377-4986-a1ea-5b70b59b6720 admin admin] PATH_INFO: `/v3/projects/a647fdfd1f874248ac627bddaeb3fa78/users/4798e353d2db43bfa0fa344e0823cfc8/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.900714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1c903-f377-4986-a1ea-5b70b59b6720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a647fdfd1f874248ac627bddaeb3fa78, user_id=4798e353d2db43bfa0fa344e0823cfc8, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:41.903895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1c903-f377-4986-a1ea-5b70b59b6720 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:41.949969 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e2b5b1a76641efa14968f11fd10f27', 'request_id': 'req-295f9f73-4bfc-4899-9784-e81b5b6dcc00'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.951603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 979/1966] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:41 2022] PUT /identity/v3/projects/a647fdfd1f874248ac627bddaeb3fa78/users/4798e353d2db43bfa0fa344e0823cfc8/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:41.953853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f60aa-7242-4f3f-97e4-dc3160806164 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:41.954147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f60aa-7242-4f3f-97e4-dc3160806164 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:41.954581 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f60aa-7242-4f3f-97e4-dc3160806164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:41.966614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e2b5b1a76641efa14968f11fd10f27', 'request_id': 'req-295f9f73-4bfc-4899-9784-e81b5b6dcc00'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:41.981973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e2b5b1a76641efa14968f11fd10f27', 'request_id': 'req-295f9f73-4bfc-4899-9784-e81b5b6dcc00'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:42.006983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] The token cache is being invalidate because project 10e2b5b1a76641efa14968f11fd10f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:42.007245 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a80f60aa-7242-4f3f-97e4-dc3160806164 None None] MFA Rules not processed for user `4798e353d2db43bfa0fa344e0823cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:42.007361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:42.008052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-295f9f73-4bfc-4899-9784-e81b5b6dcc00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:42.010746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 988/1967] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:41 2022] DELETE /identity/v3/projects/10e2b5b1a76641efa14968f11fd10f27 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:42.011210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a80f60aa-7242-4f3f-97e4-dc3160806164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:42.018324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c371-1226-4e2a-a542-35e2c2588b55 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.018992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c371-1226-4e2a-a542-35e2c2588b55 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.020124 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c371-1226-4e2a-a542-35e2c2588b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.072822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8b78c371-1226-4e2a-a542-35e2c2588b55 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:42.076952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8b78c371-1226-4e2a-a542-35e2c2588b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:42.121995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 980/1968] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:42.130528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f60aa-7242-4f3f-97e4-dc3160806164 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.132414 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a80f60aa-7242-4f3f-97e4-dc3160806164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:42.200072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 989/1969] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:42.209309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11d2f-3341-4271-be78-2441fb251346 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.209711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11d2f-3341-4271-be78-2441fb251346 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.210236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11d2f-3341-4271-be78-2441fb251346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.221958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f60aa-7242-4f3f-97e4-dc3160806164 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.228453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428fa8b-3e85-4a9f-91e2-28366957b249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.229305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428fa8b-3e85-4a9f-91e2-28366957b249 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.229642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428fa8b-3e85-4a9f-91e2-28366957b249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.230013 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428fa8b-3e85-4a9f-91e2-28366957b249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.230704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428fa8b-3e85-4a9f-91e2-28366957b249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.231400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-45d11d2f-3341-4271-be78-2441fb251346 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:42.232335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45d11d2f-3341-4271-be78-2441fb251346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:42.232618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428fa8b-3e85-4a9f-91e2-28366957b249 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.242645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 990/1970] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:42.246639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11d2f-3341-4271-be78-2441fb251346 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.257717 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11d2f-3341-4271-be78-2441fb251346 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.257858 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:42.263726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5779c-2c91-4ae0-97a4-a146b0fafda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.264559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5779c-2c91-4ae0-97a4-a146b0fafda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.264914 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5779c-2c91-4ae0-97a4-a146b0fafda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.265358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5779c-2c91-4ae0-97a4-a146b0fafda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.266364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5779c-2c91-4ae0-97a4-a146b0fafda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:14:42.266770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5779c-2c91-4ae0-97a4-a146b0fafda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.268659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5779c-2c91-4ae0-97a4-a146b0fafda5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.282399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 981/1971] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:42 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:42.283469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428fa8b-3e85-4a9f-91e2-28366957b249 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.290768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 991/1972] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:14:42.295933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5779c-2c91-4ae0-97a4-a146b0fafda5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.312111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5779c-2c91-4ae0-97a4-a146b0fafda5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.327915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:42.382704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428fa8b-3e85-4a9f-91e2-28366957b249 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.387878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63d7c-8e6e-45a1-ac67-af1ea87b2ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.388747 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63d7c-8e6e-45a1-ac67-af1ea87b2ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.389140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63d7c-8e6e-45a1-ac67-af1ea87b2ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.389588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d63d7c-8e6e-45a1-ac67-af1ea87b2ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.390484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d63d7c-8e6e-45a1-ac67-af1ea87b2ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.392550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d63d7c-8e6e-45a1-ac67-af1ea87b2ebd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.410399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fafd1-3e4d-4f40-94a7-844fb666ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.411362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fafd1-3e4d-4f40-94a7-844fb666ca10 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.411681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fafd1-3e4d-4f40-94a7-844fb666ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.411964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fafd1-3e4d-4f40-94a7-844fb666ca10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.412667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fafd1-3e4d-4f40-94a7-844fb666ca10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.414639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fafd1-3e4d-4f40-94a7-844fb666ca10 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.424242 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 982/1973] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:42 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:42.426204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63d7c-8e6e-45a1-ac67-af1ea87b2ebd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.439888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d63d7c-8e6e-45a1-ac67-af1ea87b2ebd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.446587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0e04a-2e9a-47d3-bae0-927f07caad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.447420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0e04a-2e9a-47d3-bae0-927f07caad69 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.447713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0e04a-2e9a-47d3-bae0-927f07caad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.448039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 992/1974] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:42 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:42.448354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0e04a-2e9a-47d3-bae0-927f07caad69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.449572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0e04a-2e9a-47d3-bae0-927f07caad69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.451522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0e04a-2e9a-47d3-bae0-927f07caad69 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.452374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fafd1-3e4d-4f40-94a7-844fb666ca10 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.480026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 983/1975] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:42.481987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0e04a-2e9a-47d3-bae0-927f07caad69 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.494264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0e04a-2e9a-47d3-bae0-927f07caad69 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.534713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fafd1-3e4d-4f40-94a7-844fb666ca10 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.541697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339cfc8-4ed3-4c4e-a597-3b45024eacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.542560 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339cfc8-4ed3-4c4e-a597-3b45024eacdf admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.542943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339cfc8-4ed3-4c4e-a597-3b45024eacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.543318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339cfc8-4ed3-4c4e-a597-3b45024eacdf admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.544125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339cfc8-4ed3-4c4e-a597-3b45024eacdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.546932 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339cfc8-4ed3-4c4e-a597-3b45024eacdf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.573522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 993/1976] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:42 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:42.577104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339cfc8-4ed3-4c4e-a597-3b45024eacdf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.589915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339cfc8-4ed3-4c4e-a597-3b45024eacdf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.595600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64f27a-d7ec-4268-b621-ace68cf0aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.596375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64f27a-d7ec-4268-b621-ace68cf0aa93 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.596688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64f27a-d7ec-4268-b621-ace68cf0aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.596968 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64f27a-d7ec-4268-b621-ace68cf0aa93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.598302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64f27a-d7ec-4268-b621-ace68cf0aa93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.600053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64f27a-d7ec-4268-b621-ace68cf0aa93 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.600539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619a69-0efb-4e71-b2af-65cf7016fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.601560 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619a69-0efb-4e71-b2af-65cf7016fcd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.601920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619a69-0efb-4e71-b2af-65cf7016fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.602308 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619a69-0efb-4e71-b2af-65cf7016fcd4 admin admin] PATH_INFO: `/v3/projects/1c64f16dbdab4bb481f3a093ca94375b/users/803e9ee513974950b6ea583fee5a0839/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.611122 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 994/1977] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:42.615215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64f27a-d7ec-4268-b621-ace68cf0aa93 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.623287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9619a69-0efb-4e71-b2af-65cf7016fcd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c64f16dbdab4bb481f3a093ca94375b, user_id=803e9ee513974950b6ea583fee5a0839, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.629135 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64f27a-d7ec-4268-b621-ace68cf0aa93 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.636141 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34774b1a-b079-46a5-a1a8-91e8451fca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.636987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34774b1a-b079-46a5-a1a8-91e8451fca68 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.637358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34774b1a-b079-46a5-a1a8-91e8451fca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.637725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34774b1a-b079-46a5-a1a8-91e8451fca68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.638274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9619a69-0efb-4e71-b2af-65cf7016fcd4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.638753 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34774b1a-b079-46a5-a1a8-91e8451fca68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.646893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34774b1a-b079-46a5-a1a8-91e8451fca68 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.660988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 995/1978] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:14:42.665828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34774b1a-b079-46a5-a1a8-91e8451fca68 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.673683 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 984/1979] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:42 2022] PUT /identity/v3/projects/1c64f16dbdab4bb481f3a093ca94375b/users/803e9ee513974950b6ea583fee5a0839/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:42.679345 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619a69-0efb-4e71-b2af-65cf7016fcd4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.686203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34774b1a-b079-46a5-a1a8-91e8451fca68 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.781794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0d9f-7715-421c-89b1-064c834d0017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.783501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0d9f-7715-421c-89b1-064c834d0017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.783931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0d9f-7715-421c-89b1-064c834d0017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.784097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:42.784351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0d9f-7715-421c-89b1-064c834d0017 admin admin] PATH_INFO: `/v3/projects/171e0f30ac9e4db490e95dc3133c1c39/users/ff7773c496a94726a66a18154d5792e9/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.789174 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619a69-0efb-4e71-b2af-65cf7016fcd4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.802630 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:42.806813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783b651-d8de-4f1e-898e-e088ffa8fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.807496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783b651-d8de-4f1e-898e-e088ffa8fc5a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.807820 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783b651-d8de-4f1e-898e-e088ffa8fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.808137 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783b651-d8de-4f1e-898e-e088ffa8fc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.808388 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0d9f-7715-421c-89b1-064c834d0017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171e0f30ac9e4db490e95dc3133c1c39, user_id=ff7773c496a94726a66a18154d5792e9, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.808918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783b651-d8de-4f1e-898e-e088ffa8fc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.810586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783b651-d8de-4f1e-898e-e088ffa8fc5a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.813056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0d9f-7715-421c-89b1-064c834d0017 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.821767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 985/1980] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:42.825580 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783b651-d8de-4f1e-898e-e088ffa8fc5a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:42.836612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783b651-d8de-4f1e-898e-e088ffa8fc5a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:42.847642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 996/1981] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:42 2022] PUT /identity/v3/projects/171e0f30ac9e4db490e95dc3133c1c39/users/ff7773c496a94726a66a18154d5792e9/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:42.858382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf557692-1b31-401d-bfec-a8e544f45e3c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.858788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf557692-1b31-401d-bfec-a8e544f45e3c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.858973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf557692-1b31-401d-bfec-a8e544f45e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.891292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bf557692-1b31-401d-bfec-a8e544f45e3c None None] MFA Rules not processed for user `ff7773c496a94726a66a18154d5792e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:42.893884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf557692-1b31-401d-bfec-a8e544f45e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:42.913373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30066c7e-22f8-45bf-89e5-238bdfbf682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:42.914361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066c7e-22f8-45bf-89e5-238bdfbf682d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.914927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066c7e-22f8-45bf-89e5-238bdfbf682d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.914927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30066c7e-22f8-45bf-89e5-238bdfbf682d admin admin] PATH_INFO: `/v3/projects/1c64f16dbdab4bb481f3a093ca94375b/users/803e9ee513974950b6ea583fee5a0839/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:42.918517 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066c7e-22f8-45bf-89e5-238bdfbf682d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c64f16dbdab4bb481f3a093ca94375b, user_id=803e9ee513974950b6ea583fee5a0839, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:42.922507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30066c7e-22f8-45bf-89e5-238bdfbf682d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:42.939828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 986/1982] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:42 2022] PUT /identity/v3/projects/1c64f16dbdab4bb481f3a093ca94375b/users/803e9ee513974950b6ea583fee5a0839/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:14:42.950570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80914906-7230-464e-9a82-fff27a4ea7e0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:42.950861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80914906-7230-464e-9a82-fff27a4ea7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:42.951146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80914906-7230-464e-9a82-fff27a4ea7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:43.001156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 997/1983] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:43.007662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-80914906-7230-464e-9a82-fff27a4ea7e0 None None] MFA Rules not processed for user `803e9ee513974950b6ea583fee5a0839`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:43.008931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-80914906-7230-464e-9a82-fff27a4ea7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:43.012902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf557692-1b31-401d-bfec-a8e544f45e3c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:43.014450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf557692-1b31-401d-bfec-a8e544f45e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:43.083539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf557692-1b31-401d-bfec-a8e544f45e3c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:43.096047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 987/1984] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:14:43.110981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80914906-7230-464e-9a82-fff27a4ea7e0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:43.112392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-80914906-7230-464e-9a82-fff27a4ea7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:43.135335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3804-d68e-4f4e-b30e-b1df71e2ca15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:43.136038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3804-d68e-4f4e-b30e-b1df71e2ca15 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:43.136361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3804-d68e-4f4e-b30e-b1df71e2ca15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:43.136659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3804-d68e-4f4e-b30e-b1df71e2ca15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:43.170190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80914906-7230-464e-9a82-fff27a4ea7e0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:43.173782 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8451db6-ea81-4549-a4e5-3c7eddcd2083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:43.174431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8451db6-ea81-4549-a4e5-3c7eddcd2083 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:43.174710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8451db6-ea81-4549-a4e5-3c7eddcd2083 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:43.174986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8451db6-ea81-4549-a4e5-3c7eddcd2083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:43.185678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:43.196825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d3804-d68e-4f4e-b30e-b1df71e2ca15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:43.198459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d3804-d68e-4f4e-b30e-b1df71e2ca15 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:43.204653 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:43.209291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 998/1985] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:43.242527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8451db6-ea81-4549-a4e5-3c7eddcd2083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:43.244165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8451db6-ea81-4549-a4e5-3c7eddcd2083 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:43.255022 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 988/1986] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:53.203815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:53.250219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=15 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:57.245743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3804-d68e-4f4e-b30e-b1df71e2ca15 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:57.254029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3804-d68e-4f4e-b30e-b1df71e2ca15 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:57.258031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542e184-5035-4fd8-8430-4de7f418f2e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:57.258765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e184-5035-4fd8-8430-4de7f418f2e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:57.259126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e184-5035-4fd8-8430-4de7f418f2e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:57.259470 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e184-5035-4fd8-8430-4de7f418f2e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:57.269608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542e184-5035-4fd8-8430-4de7f418f2e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:57.271155 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542e184-5035-4fd8-8430-4de7f418f2e0 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:57.283918 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 999/1987] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:14:58.108612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8451db6-ea81-4549-a4e5-3c7eddcd2083 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:58.180969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8451db6-ea81-4549-a4e5-3c7eddcd2083 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:58.186068 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:58.186988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:58.187317 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:58.187694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] PATH_INFO: `/v3/users/ff7773c496a94726a66a18154d5792e9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:58.189133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7773c496a94726a66a18154d5792e9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:58.191263 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:58.272874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7773c496a94726a66a18154d5792e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:58.291725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7773c496a94726a66a18154d5792e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:58.304351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7773c496a94726a66a18154d5792e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:58.318505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7773c496a94726a66a18154d5792e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:58.319593 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7773c496a94726a66a18154d5792e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:58.334345 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 989/1988] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:58 2022] DELETE /identity/v3/users/ff7773c496a94726a66a18154d5792e9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:58.336371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a046ca-2231-4080-85e9-e6a49431d2c8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:58.336827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a046ca-2231-4080-85e9-e6a49431d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:58.337111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a046ca-2231-4080-85e9-e6a49431d2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:58.366986 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-65a046ca-2231-4080-85e9-e6a49431d2c8 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:58.371660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-65a046ca-2231-4080-85e9-e6a49431d2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:58.466944 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1000/1989] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:58.476602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:58.478134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:58.557569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b203f8-2a88-4867-bdcc-3b9520c19b93 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:58.561423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab1e31-b11b-4c2c-b8a8-c384b18e07a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:58.562258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab1e31-b11b-4c2c-b8a8-c384b18e07a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:58.562640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab1e31-b11b-4c2c-b8a8-c384b18e07a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:58.563209 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab1e31-b11b-4c2c-b8a8-c384b18e07a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:58.580932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab1e31-b11b-4c2c-b8a8-c384b18e07a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:58.588043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab1e31-b11b-4c2c-b8a8-c384b18e07a7 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:58.599173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 990/1990] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:14:59.187467 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a046ca-2231-4080-85e9-e6a49431d2c8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:59.188920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-65a046ca-2231-4080-85e9-e6a49431d2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:59.202184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a046ca-2231-4080-85e9-e6a49431d2c8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:59.214286 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:59.215297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.215657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.215992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] PATH_INFO: `/v3/projects/171e0f30ac9e4db490e95dc3133c1c39` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.217377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=171e0f30ac9e4db490e95dc3133c1c39)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:59.219374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:59.272463 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171e0f30ac9e4db490e95dc3133c1c39', 'request_id': 'req-dcd846a4-8461-45fc-a948-b703a8bdefcf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:59.278992 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171e0f30ac9e4db490e95dc3133c1c39', 'request_id': 'req-dcd846a4-8461-45fc-a948-b703a8bdefcf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:59.285864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171e0f30ac9e4db490e95dc3133c1c39', 'request_id': 'req-dcd846a4-8461-45fc-a948-b703a8bdefcf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:59.300166 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] The token cache is being invalidate because project 171e0f30ac9e4db490e95dc3133c1c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:14:59.300643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:59.301562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd846a4-8461-45fc-a948-b703a8bdefcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:14:59.303162 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1001/1991] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:14:59 2022] DELETE /identity/v3/projects/171e0f30ac9e4db490e95dc3133c1c39 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:59.309651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5a4b6-6964-4fd4-80c8-4d5f8e58cbc6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.310158 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5a4b6-6964-4fd4-80c8-4d5f8e58cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.310252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5a4b6-6964-4fd4-80c8-4d5f8e58cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.328387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-29a5a4b6-6964-4fd4-80c8-4d5f8e58cbc6 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:59.329619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-29a5a4b6-6964-4fd4-80c8-4d5f8e58cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:59.351369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:59.405489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 991/1992] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:59.415364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0245e2-3911-443d-b86c-090d2d2f281c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.415908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0245e2-3911-443d-b86c-090d2d2f281c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.415908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0245e2-3911-443d-b86c-090d2d2f281c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.436227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0a0245e2-3911-443d-b86c-090d2d2f281c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:59.437942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a0245e2-3911-443d-b86c-090d2d2f281c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:59.446996 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1002/1993] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:59.451417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5a4b6-6964-4fd4-80c8-4d5f8e58cbc6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:59.462084 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5a4b6-6964-4fd4-80c8-4d5f8e58cbc6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:59.466832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7e2d4-a4e4-4a18-8658-9f04d03821c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:59.467512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7e2d4-a4e4-4a18-8658-9f04d03821c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.467795 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7e2d4-a4e4-4a18-8658-9f04d03821c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.468076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7e2d4-a4e4-4a18-8658-9f04d03821c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.468851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7e2d4-a4e4-4a18-8658-9f04d03821c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:14:59.469160 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7e2d4-a4e4-4a18-8658-9f04d03821c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:59.470848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7e2d4-a4e4-4a18-8658-9f04d03821c7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:59.485350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 992/1994] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:14:59.494352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0245e2-3911-443d-b86c-090d2d2f281c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:59.505505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0245e2-3911-443d-b86c-090d2d2f281c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:59.511166 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93140216-4bf3-4fb4-8872-1a049c389004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:59.511871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93140216-4bf3-4fb4-8872-1a049c389004 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.512156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93140216-4bf3-4fb4-8872-1a049c389004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.512433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93140216-4bf3-4fb4-8872-1a049c389004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.513149 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93140216-4bf3-4fb4-8872-1a049c389004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:59.515101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93140216-4bf3-4fb4-8872-1a049c389004 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:59.548523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1003/1995] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:14:59 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:14:59.549802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7e2d4-a4e4-4a18-8658-9f04d03821c7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:59.560155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7e2d4-a4e4-4a18-8658-9f04d03821c7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:59.626603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b1ce-9277-4d23-8b70-849cf506effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:59.627278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b1ce-9277-4d23-8b70-849cf506effc admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.627558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b1ce-9277-4d23-8b70-849cf506effc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.627837 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b1ce-9277-4d23-8b70-849cf506effc admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.629059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b1ce-9277-4d23-8b70-849cf506effc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:59.631260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b1ce-9277-4d23-8b70-849cf506effc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:59.658548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 993/1996] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:14:59 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:14:59.660276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93140216-4bf3-4fb4-8872-1a049c389004 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:59.673037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93140216-4bf3-4fb4-8872-1a049c389004 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:59.678746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47aafb-e5a5-4abd-b602-3e40e4fd7409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:59.679427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47aafb-e5a5-4abd-b602-3e40e4fd7409 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.679718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47aafb-e5a5-4abd-b602-3e40e4fd7409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.680015 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47aafb-e5a5-4abd-b602-3e40e4fd7409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.680732 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47aafb-e5a5-4abd-b602-3e40e4fd7409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:59.682468 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47aafb-e5a5-4abd-b602-3e40e4fd7409 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:59.699547 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1004/1997] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:14:59.700402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b1ce-9277-4d23-8b70-849cf506effc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:59.712239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b1ce-9277-4d23-8b70-849cf506effc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:59.717033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286cda6-54c7-44c5-9ced-b3f0040b625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:59.717746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286cda6-54c7-44c5-9ced-b3f0040b625a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.718037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286cda6-54c7-44c5-9ced-b3f0040b625a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.718321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286cda6-54c7-44c5-9ced-b3f0040b625a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.719060 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286cda6-54c7-44c5-9ced-b3f0040b625a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:59.720716 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286cda6-54c7-44c5-9ced-b3f0040b625a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:59.736718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 994/1998] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:14:59.738425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47aafb-e5a5-4abd-b602-3e40e4fd7409 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:59.751256 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47aafb-e5a5-4abd-b602-3e40e4fd7409 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:59.757289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eed279-95bb-4586-a62f-3e9f32bf5b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:59.758221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eed279-95bb-4586-a62f-3e9f32bf5b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.758498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eed279-95bb-4586-a62f-3e9f32bf5b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.759581 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eed279-95bb-4586-a62f-3e9f32bf5b95 admin admin] PATH_INFO: `/v3/projects/b7fedc0dd96c4abea87e3c3bbd87acd8/users/ec499fa15e944f58b837880863e1d33e/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.777324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eed279-95bb-4586-a62f-3e9f32bf5b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fedc0dd96c4abea87e3c3bbd87acd8, user_id=ec499fa15e944f58b837880863e1d33e, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:59.781129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eed279-95bb-4586-a62f-3e9f32bf5b95 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:59.820713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1005/1999] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:14:59 2022] PUT /identity/v3/projects/b7fedc0dd96c4abea87e3c3bbd87acd8/users/ec499fa15e944f58b837880863e1d33e/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:14:59.821843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa882f-c31a-4d05-9277-4b42d703556f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.823054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa882f-c31a-4d05-9277-4b42d703556f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.823353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa882f-c31a-4d05-9277-4b42d703556f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.829910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eed279-95bb-4586-a62f-3e9f32bf5b95 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:59.835934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d3eed279-95bb-4586-a62f-3e9f32bf5b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:59.853018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:14:59.854836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e0fa882f-c31a-4d05-9277-4b42d703556f None None] MFA Rules not processed for user `ec499fa15e944f58b837880863e1d33e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:14:59.856046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0fa882f-c31a-4d05-9277-4b42d703556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:14:59.968188 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eed279-95bb-4586-a62f-3e9f32bf5b95 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:14:59.974408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:14:59.975648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:14:59.975978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:14:59.976238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] PATH_INFO: `/v3/users/1761ac0e3b7142b5a536a20da4889f57` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:14:59.977863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1761ac0e3b7142b5a536a20da4889f57)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:14:59.982174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:14:59.990787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 995/2000] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:14:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:14:59.992863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa882f-c31a-4d05-9277-4b42d703556f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:14:59.994726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0fa882f-c31a-4d05-9277-4b42d703556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:00.042106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:00.048930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1761ac0e3b7142b5a536a20da4889f57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.071089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1761ac0e3b7142b5a536a20da4889f57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.083021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1761ac0e3b7142b5a536a20da4889f57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.084190 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1761ac0e3b7142b5a536a20da4889f57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.085011 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afd9ffb9-f68f-4c13-93ed-9a307e9ac802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1761ac0e3b7142b5a536a20da4889f57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.107053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1006/2001] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:14:59 2022] DELETE /identity/v3/users/1761ac0e3b7142b5a536a20da4889f57 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:00.111622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4562-d8f8-4711-a5b0-e3b779c0d835 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:00.112940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4562-d8f8-4711-a5b0-e3b779c0d835 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:00.113455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4562-d8f8-4711-a5b0-e3b779c0d835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:00.121731 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa882f-c31a-4d05-9277-4b42d703556f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:00.141279 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-07da4562-d8f8-4711-a5b0-e3b779c0d835 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:00.143304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-07da4562-d8f8-4711-a5b0-e3b779c0d835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:00.210502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:00.211473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:00.211924 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:00.212449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:00.214338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:00.259136 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1007/2002] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:00.271378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4562-d8f8-4711-a5b0-e3b779c0d835 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:00.273675 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-07da4562-d8f8-4711-a5b0-e3b779c0d835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:00.307702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:00.310706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:00.320696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:00.330958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 996/2003] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:14:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:15:00.365725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4562-d8f8-4711-a5b0-e3b779c0d835 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:00.370204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7cc1-f521-4110-8be4-c4215a4548df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:00.370880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7cc1-f521-4110-8be4-c4215a4548df service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:00.371240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7cc1-f521-4110-8be4-c4215a4548df service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:00.371504 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7cc1-f521-4110-8be4-c4215a4548df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:00.384092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7cc1-f521-4110-8be4-c4215a4548df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:00.386019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7cc1-f521-4110-8be4-c4215a4548df service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:00.401283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1008/2004] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:15:00.815271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:00.817503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:00.839042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a918e4e-9a4f-4a01-aa48-62c6069d809b service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:00.851960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:00.853276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:00.853768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:00.857625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] PATH_INFO: `/v3/projects/6b8aa6c1bef848329cc1775ce7ffd86f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:00.859701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8aa6c1bef848329cc1775ce7ffd86f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:00.862711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:00.928423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8aa6c1bef848329cc1775ce7ffd86f', 'request_id': 'req-884d88fa-e8aa-423c-8a16-c46035646cef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.939031 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8aa6c1bef848329cc1775ce7ffd86f', 'request_id': 'req-884d88fa-e8aa-423c-8a16-c46035646cef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.949730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8aa6c1bef848329cc1775ce7ffd86f', 'request_id': 'req-884d88fa-e8aa-423c-8a16-c46035646cef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.966310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] The token cache is being invalidate because project 6b8aa6c1bef848329cc1775ce7ffd86f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:15:00.966597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.967265 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-884d88fa-e8aa-423c-8a16-c46035646cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:00.973019 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 997/2005] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:15:00 2022] DELETE /identity/v3/projects/6b8aa6c1bef848329cc1775ce7ffd86f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:00.974614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2c3d-91cc-431b-84dc-1d1a481ded76 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:00.975118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2c3d-91cc-431b-84dc-1d1a481ded76 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:00.975202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2c3d-91cc-431b-84dc-1d1a481ded76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:00.999123 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9f8e2c3d-91cc-431b-84dc-1d1a481ded76 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:01.000639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9f8e2c3d-91cc-431b-84dc-1d1a481ded76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:01.077556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1009/2006] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:01.085341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9cb86-dbd2-4174-bf8d-0b7b4b1e3ac5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:01.085531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9cb86-dbd2-4174-bf8d-0b7b4b1e3ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:01.085818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9cb86-dbd2-4174-bf8d-0b7b4b1e3ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:01.108214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a1b9cb86-dbd2-4174-bf8d-0b7b4b1e3ac5 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:01.111586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a1b9cb86-dbd2-4174-bf8d-0b7b4b1e3ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:01.120359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 998/2007] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:01.124531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e2c3d-91cc-431b-84dc-1d1a481ded76 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:01.136742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e2c3d-91cc-431b-84dc-1d1a481ded76 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:01.141575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a12fc-ab65-41b1-8c7b-7dd8398b979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:01.142327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a12fc-ab65-41b1-8c7b-7dd8398b979e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:01.142691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a12fc-ab65-41b1-8c7b-7dd8398b979e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:01.143071 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a12fc-ab65-41b1-8c7b-7dd8398b979e admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:01.143911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a12fc-ab65-41b1-8c7b-7dd8398b979e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:15:01.144847 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a12fc-ab65-41b1-8c7b-7dd8398b979e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:01.146626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a12fc-ab65-41b1-8c7b-7dd8398b979e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:01.158970 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1010/2008] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:15:01.163923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9cb86-dbd2-4174-bf8d-0b7b4b1e3ac5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:01.169591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:01.174027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9cb86-dbd2-4174-bf8d-0b7b4b1e3ac5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:01.184156 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ec3de-c7db-40cb-ba91-acb15f720d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:01.184849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ec3de-c7db-40cb-ba91-acb15f720d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:01.185579 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ec3de-c7db-40cb-ba91-acb15f720d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:01.186402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ec3de-c7db-40cb-ba91-acb15f720d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:01.187360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ec3de-c7db-40cb-ba91-acb15f720d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:01.189527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ec3de-c7db-40cb-ba91-acb15f720d01 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:01.221763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 999/2009] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:15:01 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:01.226750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a12fc-ab65-41b1-8c7b-7dd8398b979e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:01.247825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a12fc-ab65-41b1-8c7b-7dd8398b979e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:01.324526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1808f-dc51-4d8d-b31d-7b127c05d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:01.325621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1808f-dc51-4d8d-b31d-7b127c05d529 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:01.326275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1808f-dc51-4d8d-b31d-7b127c05d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:01.326562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1808f-dc51-4d8d-b31d-7b127c05d529 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:01.327268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1808f-dc51-4d8d-b31d-7b127c05d529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:01.329250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1808f-dc51-4d8d-b31d-7b127c05d529 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:01.357523 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1011/2010] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:15:01 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:01.359101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ec3de-c7db-40cb-ba91-acb15f720d01 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:01.371122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ec3de-c7db-40cb-ba91-acb15f720d01 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:01.376205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26145199-47fb-4e65-9a7c-8001e0d5969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:01.376882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26145199-47fb-4e65-9a7c-8001e0d5969e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:01.377169 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26145199-47fb-4e65-9a7c-8001e0d5969e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:01.377449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26145199-47fb-4e65-9a7c-8001e0d5969e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:01.378213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26145199-47fb-4e65-9a7c-8001e0d5969e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:01.380286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26145199-47fb-4e65-9a7c-8001e0d5969e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:01.392225 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1000/2011] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:01.396875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1808f-dc51-4d8d-b31d-7b127c05d529 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:01.407155 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1808f-dc51-4d8d-b31d-7b127c05d529 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:01.413138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08b068-f80d-4a09-aa94-9567fd47eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:01.414392 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08b068-f80d-4a09-aa94-9567fd47eebd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:01.414392 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08b068-f80d-4a09-aa94-9567fd47eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:01.414610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08b068-f80d-4a09-aa94-9567fd47eebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:01.415252 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08b068-f80d-4a09-aa94-9567fd47eebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:01.416897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08b068-f80d-4a09-aa94-9567fd47eebd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:01.427645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1012/2012] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:01.431787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26145199-47fb-4e65-9a7c-8001e0d5969e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:01.442197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26145199-47fb-4e65-9a7c-8001e0d5969e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:01.446873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a571d-b7c0-4326-a945-57143d6a5076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:01.447752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a571d-b7c0-4326-a945-57143d6a5076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:01.448039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a571d-b7c0-4326-a945-57143d6a5076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:01.448322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a571d-b7c0-4326-a945-57143d6a5076 admin admin] PATH_INFO: `/v3/projects/18259dbe74bf42f3ba58714b45bb35c1/users/9dc2413a5be94197b9a356b92e090122/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:01.469844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a571d-b7c0-4326-a945-57143d6a5076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18259dbe74bf42f3ba58714b45bb35c1, user_id=9dc2413a5be94197b9a356b92e090122, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:01.473462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a571d-b7c0-4326-a945-57143d6a5076 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:01.488642 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1001/2013] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:15:01 2022] PUT /identity/v3/projects/18259dbe74bf42f3ba58714b45bb35c1/users/9dc2413a5be94197b9a356b92e090122/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:01.499649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc86f-8b5e-45f9-85be-a9bbeb46944f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:01.499946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc86f-8b5e-45f9-85be-a9bbeb46944f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:01.500231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc86f-8b5e-45f9-85be-a9bbeb46944f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:01.532693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d4ffc86f-8b5e-45f9-85be-a9bbeb46944f None None] MFA Rules not processed for user `9dc2413a5be94197b9a356b92e090122`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:01.533943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d4ffc86f-8b5e-45f9-85be-a9bbeb46944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:01.558933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:01.601167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1013/2014] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:01.611674 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a571d-b7c0-4326-a945-57143d6a5076 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:01.613538 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0c8a571d-b7c0-4326-a945-57143d6a5076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:01.677358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a571d-b7c0-4326-a945-57143d6a5076 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:01.681091 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deae520-e382-4a5b-b048-055a5a229067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:01.681800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deae520-e382-4a5b-b048-055a5a229067 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:01.682115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deae520-e382-4a5b-b048-055a5a229067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:01.682393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deae520-e382-4a5b-b048-055a5a229067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:01.693823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deae520-e382-4a5b-b048-055a5a229067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:01.695255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deae520-e382-4a5b-b048-055a5a229067 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:01.704522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1002/2015] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:15:09.822542 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffc86f-8b5e-45f9-85be-a9bbeb46944f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:09.823956 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d4ffc86f-8b5e-45f9-85be-a9bbeb46944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:09.891327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffc86f-8b5e-45f9-85be-a9bbeb46944f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:09.895839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:09.897852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:09.898142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:09.898425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] PATH_INFO: `/v3/users/4798e353d2db43bfa0fa344e0823cfc8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:09.899648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4798e353d2db43bfa0fa344e0823cfc8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:09.902393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:09.962592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4798e353d2db43bfa0fa344e0823cfc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:09.975748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4798e353d2db43bfa0fa344e0823cfc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:09.983144 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4798e353d2db43bfa0fa344e0823cfc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:09.984341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4798e353d2db43bfa0fa344e0823cfc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:09.984629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c713db74-0188-4faa-972f-5ad5a05fe220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4798e353d2db43bfa0fa344e0823cfc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:09.988724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deae520-e382-4a5b-b048-055a5a229067 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:10.000462 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deae520-e382-4a5b-b048-055a5a229067 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:10.002802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1014/2016] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:15:09 2022] DELETE /identity/v3/users/4798e353d2db43bfa0fa344e0823cfc8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:10.006309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:10.007176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.007455 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.007730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] PATH_INFO: `/v3/users/9dc2413a5be94197b9a356b92e090122` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.008335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1225101-ed98-4009-a9f6-1ca3910a80d0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.008608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1225101-ed98-4009-a9f6-1ca3910a80d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.008890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1225101-ed98-4009-a9f6-1ca3910a80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.010436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc2413a5be94197b9a356b92e090122)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:10.013110 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:10.027425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c1225101-ed98-4009-a9f6-1ca3910a80d0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:10.028647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c1225101-ed98-4009-a9f6-1ca3910a80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:10.066458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc2413a5be94197b9a356b92e090122'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.077362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:10.081077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc2413a5be94197b9a356b92e090122'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.091147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc2413a5be94197b9a356b92e090122'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.100892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc2413a5be94197b9a356b92e090122'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.101714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc2413a5be94197b9a356b92e090122'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.104669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1015/2017] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:10.107982 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1003/2018] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:15:09 2022] DELETE /identity/v3/users/9dc2413a5be94197b9a356b92e090122 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:15:10.112331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690ab84-734e-491a-b054-88009fc741d1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.112626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690ab84-734e-491a-b054-88009fc741d1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.112913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690ab84-734e-491a-b054-88009fc741d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.114380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:10.116507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:10.131917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4690ab84-734e-491a-b054-88009fc741d1 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:10.133096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4690ab84-734e-491a-b054-88009fc741d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:10.143152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:10.177113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248949f0-0a39-4ef0-bb94-fc6c932500f9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:10.181670 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:10.182522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.182804 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.183077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.185103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:10.196802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1016/2019] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:10.206282 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690ab84-734e-491a-b054-88009fc741d1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:10.215952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690ab84-734e-491a-b054-88009fc741d1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:10.219582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9b383-73b7-4a0f-bd76-9ef050a930b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:10.220216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9b383-73b7-4a0f-bd76-9ef050a930b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.220505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9b383-73b7-4a0f-bd76-9ef050a930b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.220865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9b383-73b7-4a0f-bd76-9ef050a930b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.230521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9b383-73b7-4a0f-bd76-9ef050a930b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:10.231999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9b383-73b7-4a0f-bd76-9ef050a930b2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:10.242596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1017/2020] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:15:10.251115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:10.252556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:10.263245 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1004/2021] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:15:10.696542 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9b383-73b7-4a0f-bd76-9ef050a930b2 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:10.698140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9fb9b383-73b7-4a0f-bd76-9ef050a930b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:10.718522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9b383-73b7-4a0f-bd76-9ef050a930b2 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:10.726559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:10.727428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.727792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.728011 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] PATH_INFO: `/v3/projects/18259dbe74bf42f3ba58714b45bb35c1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.729249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18259dbe74bf42f3ba58714b45bb35c1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:10.731255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:10.743059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:10.744578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:10.759868 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f27a6-c4b4-40df-b4e4-189966e41394 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:10.764703 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:10.765647 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.765931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.766208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] PATH_INFO: `/v3/projects/a647fdfd1f874248ac627bddaeb3fa78` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.768558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a647fdfd1f874248ac627bddaeb3fa78)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:10.771210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:10.793600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18259dbe74bf42f3ba58714b45bb35c1', 'request_id': 'req-9400da76-a4ce-4cc5-bfaf-343be55fa109'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.800204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18259dbe74bf42f3ba58714b45bb35c1', 'request_id': 'req-9400da76-a4ce-4cc5-bfaf-343be55fa109'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.807464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18259dbe74bf42f3ba58714b45bb35c1', 'request_id': 'req-9400da76-a4ce-4cc5-bfaf-343be55fa109'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.820678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] The token cache is being invalidate because project 18259dbe74bf42f3ba58714b45bb35c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:15:10.820896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.821561 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9400da76-a4ce-4cc5-bfaf-343be55fa109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.822906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a647fdfd1f874248ac627bddaeb3fa78', 'request_id': 'req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.823134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1018/2022] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:15:10 2022] DELETE /identity/v3/projects/18259dbe74bf42f3ba58714b45bb35c1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:10.829852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c31eb-75c3-4877-ab90-9b651b801d1d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.830146 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c31eb-75c3-4877-ab90-9b651b801d1d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.830435 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c31eb-75c3-4877-ab90-9b651b801d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.830803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a647fdfd1f874248ac627bddaeb3fa78', 'request_id': 'req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.837345 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a647fdfd1f874248ac627bddaeb3fa78', 'request_id': 'req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.849717 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] The token cache is being invalidate because project a647fdfd1f874248ac627bddaeb3fa78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:15:10.850001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.850302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9b1c31eb-75c3-4877-ab90-9b651b801d1d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:10.850713 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:10.851491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9b1c31eb-75c3-4877-ab90-9b651b801d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:10.852324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1005/2023] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:15:10 2022] DELETE /identity/v3/projects/a647fdfd1f874248ac627bddaeb3fa78 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:10.856519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:10.857922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:10.901967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:10.921181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1019/2024] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:10.924384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:10.925365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef151a-db44-429e-95e7-5dc665f177ca None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.925693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef151a-db44-429e-95e7-5dc665f177ca None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.925974 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef151a-db44-429e-95e7-5dc665f177ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.931597 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1fda6-ec5e-46a3-b115-5d70e7d59546 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:10.937650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:10.938884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.939746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.940537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] PATH_INFO: `/v3/users/803e9ee513974950b6ea583fee5a0839` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.942156 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=803e9ee513974950b6ea583fee5a0839)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:10.945147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:10.947722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-15ef151a-db44-429e-95e7-5dc665f177ca None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:10.948962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-15ef151a-db44-429e-95e7-5dc665f177ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:10.956975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1020/2025] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:10.961277 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef151a-db44-429e-95e7-5dc665f177ca None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:10.970182 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef151a-db44-429e-95e7-5dc665f177ca None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:10.975367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4b905-2a4d-4373-a8ee-0cfc9bcbfd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:10.976031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4b905-2a4d-4373-a8ee-0cfc9bcbfd0c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:10.976320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4b905-2a4d-4373-a8ee-0cfc9bcbfd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:10.976605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4b905-2a4d-4373-a8ee-0cfc9bcbfd0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:10.977415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4b905-2a4d-4373-a8ee-0cfc9bcbfd0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:15:10.977785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4b905-2a4d-4373-a8ee-0cfc9bcbfd0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:10.979500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4b905-2a4d-4373-a8ee-0cfc9bcbfd0c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:10.993936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1021/2026] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:15:10.998110 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4b905-2a4d-4373-a8ee-0cfc9bcbfd0c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:10.998843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803e9ee513974950b6ea583fee5a0839'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.012101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4b905-2a4d-4373-a8ee-0cfc9bcbfd0c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.015243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803e9ee513974950b6ea583fee5a0839'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.018200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74adfd-ccd0-49b8-bb50-1793a7ed44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.019184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74adfd-ccd0-49b8-bb50-1793a7ed44ff admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.019637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74adfd-ccd0-49b8-bb50-1793a7ed44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.020766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74adfd-ccd0-49b8-bb50-1793a7ed44ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.022311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74adfd-ccd0-49b8-bb50-1793a7ed44ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.024553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74adfd-ccd0-49b8-bb50-1793a7ed44ff admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.025897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803e9ee513974950b6ea583fee5a0839'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.039402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803e9ee513974950b6ea583fee5a0839'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.040352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803e9ee513974950b6ea583fee5a0839'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.047783 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1006/2027] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:15:10 2022] DELETE /identity/v3/users/803e9ee513974950b6ea583fee5a0839 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:15:11.055449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1022/2028] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:15:10 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:15:11.059258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.060650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:11.139917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7004c-7bd5-4aff-b0f7-4221789902fa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.210351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfc595-969e-42ee-ac6b-3116450cf5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.211053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc595-969e-42ee-ac6b-3116450cf5cc admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.211338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc595-969e-42ee-ac6b-3116450cf5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.211614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfc595-969e-42ee-ac6b-3116450cf5cc admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.212300 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfc595-969e-42ee-ac6b-3116450cf5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.214281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfc595-969e-42ee-ac6b-3116450cf5cc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.242049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1007/2029] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:15:11 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:11.243283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74adfd-ccd0-49b8-bb50-1793a7ed44ff admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.254064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74adfd-ccd0-49b8-bb50-1793a7ed44ff admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.259828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2879c-4236-4485-8999-0ad4310f3785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.260502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2879c-4236-4485-8999-0ad4310f3785 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.260788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2879c-4236-4485-8999-0ad4310f3785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.261193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2879c-4236-4485-8999-0ad4310f3785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.261978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2879c-4236-4485-8999-0ad4310f3785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.263579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2879c-4236-4485-8999-0ad4310f3785 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.274720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1023/2030] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:11.278676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfc595-969e-42ee-ac6b-3116450cf5cc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.289922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfc595-969e-42ee-ac6b-3116450cf5cc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.294696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f1aac-0fa2-47f8-8ea3-60a079f9790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.295363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1aac-0fa2-47f8-8ea3-60a079f9790b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.295654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1aac-0fa2-47f8-8ea3-60a079f9790b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.295937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1aac-0fa2-47f8-8ea3-60a079f9790b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.296672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f1aac-0fa2-47f8-8ea3-60a079f9790b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.298318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f1aac-0fa2-47f8-8ea3-60a079f9790b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.304977 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:11.315276 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1008/2031] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:11.316641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2879c-4236-4485-8999-0ad4310f3785 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.328402 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2879c-4236-4485-8999-0ad4310f3785 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.333549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bb82b-9457-4e16-90ba-c7235b11a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.334514 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bb82b-9457-4e16-90ba-c7235b11a93a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.334797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bb82b-9457-4e16-90ba-c7235b11a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.335073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bb82b-9457-4e16-90ba-c7235b11a93a admin admin] PATH_INFO: `/v3/projects/b34a26d69ffe4ab3a2e8342ea9b078cb/users/ad3e04b4e8c94f95a65a2fc453a015c4/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.340079 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f1aac-0fa2-47f8-8ea3-60a079f9790b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.341900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-227f1aac-0fa2-47f8-8ea3-60a079f9790b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:11.352162 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bb82b-9457-4e16-90ba-c7235b11a93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34a26d69ffe4ab3a2e8342ea9b078cb, user_id=ad3e04b4e8c94f95a65a2fc453a015c4, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.359057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f1aac-0fa2-47f8-8ea3-60a079f9790b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.360278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bb82b-9457-4e16-90ba-c7235b11a93a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.363878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.364834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.367081 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.367461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] PATH_INFO: `/v3/projects/1c64f16dbdab4bb481f3a093ca94375b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.369336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c64f16dbdab4bb481f3a093ca94375b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.371695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.378526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1024/2032] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:15:11 2022] PUT /identity/v3/projects/b34a26d69ffe4ab3a2e8342ea9b078cb/users/ad3e04b4e8c94f95a65a2fc453a015c4/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:15:11.388415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47c988-648a-49b5-a1d1-1fe86b17f56e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.388711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47c988-648a-49b5-a1d1-1fe86b17f56e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.388990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47c988-648a-49b5-a1d1-1fe86b17f56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.419204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cc47c988-648a-49b5-a1d1-1fe86b17f56e None None] MFA Rules not processed for user `ad3e04b4e8c94f95a65a2fc453a015c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:11.420401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc47c988-648a-49b5-a1d1-1fe86b17f56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:11.424445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c64f16dbdab4bb481f3a093ca94375b', 'request_id': 'req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.435321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c64f16dbdab4bb481f3a093ca94375b', 'request_id': 'req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.443814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c64f16dbdab4bb481f3a093ca94375b', 'request_id': 'req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.458012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] The token cache is being invalidate because project 1c64f16dbdab4bb481f3a093ca94375b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:15:11.458307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.459021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adccb3a4-e8bd-4c4f-9b78-4d90a48a4166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:11.460607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1009/2033] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:15:11 2022] DELETE /identity/v3/projects/1c64f16dbdab4bb481f3a093ca94375b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:15:11.466791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1341033-7857-4100-a1c3-074fe5d92a86 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.467185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1341033-7857-4100-a1c3-074fe5d92a86 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.467637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1341033-7857-4100-a1c3-074fe5d92a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.488542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a1341033-7857-4100-a1c3-074fe5d92a86 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:11.490516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a1341033-7857-4100-a1c3-074fe5d92a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:11.492003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1025/2034] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:11.503140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47c988-648a-49b5-a1d1-1fe86b17f56e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.504649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc47c988-648a-49b5-a1d1-1fe86b17f56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:11.563348 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1010/2035] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:11.571886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41e29-ae56-4da7-93c9-18d5f3d47c03 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.572175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41e29-ae56-4da7-93c9-18d5f3d47c03 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.572453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41e29-ae56-4da7-93c9-18d5f3d47c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.572877 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47c988-648a-49b5-a1d1-1fe86b17f56e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.576869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8454b-7038-4bc9-b67e-04df0330217b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.577549 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8454b-7038-4bc9-b67e-04df0330217b service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.577840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8454b-7038-4bc9-b67e-04df0330217b service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.578121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8454b-7038-4bc9-b67e-04df0330217b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.589057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8454b-7038-4bc9-b67e-04df0330217b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.590640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8454b-7038-4bc9-b67e-04df0330217b service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.591721 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5ae41e29-ae56-4da7-93c9-18d5f3d47c03 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:11.593492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5ae41e29-ae56-4da7-93c9-18d5f3d47c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:11.602425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1026/2036] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:15:11.602746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1011/2037] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:11.606843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8454b-7038-4bc9-b67e-04df0330217b service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.617727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8454b-7038-4bc9-b67e-04df0330217b service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.622416 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd6738-3dee-4ee7-9a78-9717116d24c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.623065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6738-3dee-4ee7-9a78-9717116d24c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.623354 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6738-3dee-4ee7-9a78-9717116d24c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.623631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd6738-3dee-4ee7-9a78-9717116d24c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.624350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd6738-3dee-4ee7-9a78-9717116d24c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:15:11.624781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd6738-3dee-4ee7-9a78-9717116d24c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.626274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd6738-3dee-4ee7-9a78-9717116d24c7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.633947 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:11.639129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1027/2038] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:15:11.643838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae41e29-ae56-4da7-93c9-18d5f3d47c03 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.654784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae41e29-ae56-4da7-93c9-18d5f3d47c03 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.659913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ce0e-6a47-4471-bcf9-844da87bced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.660645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ce0e-6a47-4471-bcf9-844da87bced9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.661005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ce0e-6a47-4471-bcf9-844da87bced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.662518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97ce0e-6a47-4471-bcf9-844da87bced9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.662882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97ce0e-6a47-4471-bcf9-844da87bced9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.664967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97ce0e-6a47-4471-bcf9-844da87bced9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.700313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1012/2039] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:15:11 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:15:11.704263 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd6738-3dee-4ee7-9a78-9717116d24c7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.714595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd6738-3dee-4ee7-9a78-9717116d24c7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.785708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436894d-1c6f-476e-bc44-64786c750911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.786404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436894d-1c6f-476e-bc44-64786c750911 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.786824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436894d-1c6f-476e-bc44-64786c750911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.787065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436894d-1c6f-476e-bc44-64786c750911 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.787868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436894d-1c6f-476e-bc44-64786c750911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.790062 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436894d-1c6f-476e-bc44-64786c750911 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.813763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1028/2040] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:15:11 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:11.819505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ce0e-6a47-4471-bcf9-844da87bced9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.832364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97ce0e-6a47-4471-bcf9-844da87bced9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.837620 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aaa65-5a97-4e03-a886-549ba6e48c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.838282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aaa65-5a97-4e03-a886-549ba6e48c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.838562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aaa65-5a97-4e03-a886-549ba6e48c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.838834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aaa65-5a97-4e03-a886-549ba6e48c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.839644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37aaa65-5a97-4e03-a886-549ba6e48c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.841321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37aaa65-5a97-4e03-a886-549ba6e48c8b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.852533 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1013/2041] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:11.857029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436894d-1c6f-476e-bc44-64786c750911 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.869555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436894d-1c6f-476e-bc44-64786c750911 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.874494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3e2d3-9cd1-4a71-b492-248360ce50f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.875223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e2d3-9cd1-4a71-b492-248360ce50f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.875429 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e2d3-9cd1-4a71-b492-248360ce50f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.875708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3e2d3-9cd1-4a71-b492-248360ce50f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.876497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3e2d3-9cd1-4a71-b492-248360ce50f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.878217 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3e2d3-9cd1-4a71-b492-248360ce50f0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.892890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1029/2042] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:11.893866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aaa65-5a97-4e03-a886-549ba6e48c8b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:11.914143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aaa65-5a97-4e03-a886-549ba6e48c8b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:11.924682 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caabcdf-f6ab-4a0e-9eb0-9bc74bc20380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:11.925812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caabcdf-f6ab-4a0e-9eb0-9bc74bc20380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.926093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caabcdf-f6ab-4a0e-9eb0-9bc74bc20380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.926371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caabcdf-f6ab-4a0e-9eb0-9bc74bc20380 admin admin] PATH_INFO: `/v3/projects/1024c54cf4d44039bf5248c30cd87321/users/d9594779aa6e42038a5ae2d94bb41934/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:11.952921 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caabcdf-f6ab-4a0e-9eb0-9bc74bc20380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1024c54cf4d44039bf5248c30cd87321, user_id=d9594779aa6e42038a5ae2d94bb41934, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:11.955854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caabcdf-f6ab-4a0e-9eb0-9bc74bc20380 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:11.977577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1014/2043] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:15:11 2022] PUT /identity/v3/projects/1024c54cf4d44039bf5248c30cd87321/users/d9594779aa6e42038a5ae2d94bb41934/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:11.986946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bcf60-aeb8-41fa-af36-9aeff73f0158 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:11.987284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bcf60-aeb8-41fa-af36-9aeff73f0158 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:11.987624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bcf60-aeb8-41fa-af36-9aeff73f0158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:12.019557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f63bcf60-aeb8-41fa-af36-9aeff73f0158 None None] MFA Rules not processed for user `d9594779aa6e42038a5ae2d94bb41934`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:12.021330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f63bcf60-aeb8-41fa-af36-9aeff73f0158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:12.115851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1030/2044] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:12.130260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caabcdf-f6ab-4a0e-9eb0-9bc74bc20380 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:12.132262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8caabcdf-f6ab-4a0e-9eb0-9bc74bc20380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:12.158087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:12.198124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caabcdf-f6ab-4a0e-9eb0-9bc74bc20380 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:12.201881 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9e672-38d1-40ff-8934-a318d8af17cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:12.202526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9e672-38d1-40ff-8934-a318d8af17cb service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:12.202807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9e672-38d1-40ff-8934-a318d8af17cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:12.203727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9e672-38d1-40ff-8934-a318d8af17cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:12.213878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9e672-38d1-40ff-8934-a318d8af17cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:12.216873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9e672-38d1-40ff-8934-a318d8af17cb service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:12.227973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1015/2045] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:15:12.249528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bcf60-aeb8-41fa-af36-9aeff73f0158 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:12.328502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bcf60-aeb8-41fa-af36-9aeff73f0158 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:12.334695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:12.335772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:12.336055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:12.336334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] PATH_INFO: `/v3/users/d9594779aa6e42038a5ae2d94bb41934` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:12.337608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9594779aa6e42038a5ae2d94bb41934)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:12.339530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:12.345830 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:12.395174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9594779aa6e42038a5ae2d94bb41934'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:12.410614 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9594779aa6e42038a5ae2d94bb41934'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:12.419826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9594779aa6e42038a5ae2d94bb41934'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:12.420571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9594779aa6e42038a5ae2d94bb41934'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:12.421184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9594779aa6e42038a5ae2d94bb41934'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:12.445339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1031/2046] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:15:12 2022] DELETE /identity/v3/users/d9594779aa6e42038a5ae2d94bb41934 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:12.450639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3a881-fbf9-4afb-bccf-9270977be6d2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:12.450929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3a881-fbf9-4afb-bccf-9270977be6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:12.451232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3a881-fbf9-4afb-bccf-9270977be6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:12.473144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-23f3a881-fbf9-4afb-bccf-9270977be6d2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:12.476957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23f3a881-fbf9-4afb-bccf-9270977be6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:12.559136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1016/2047] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:12.572998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:12.574447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:12.644630 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7ea57-c752-455c-a5ed-84ad51f3c330 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:12.649184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d88486-39fd-4692-880d-8a565ec1b06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:12.649800 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d88486-39fd-4692-880d-8a565ec1b06b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:12.650088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d88486-39fd-4692-880d-8a565ec1b06b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:12.650366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d88486-39fd-4692-880d-8a565ec1b06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:12.659654 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d88486-39fd-4692-880d-8a565ec1b06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:12.661076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d88486-39fd-4692-880d-8a565ec1b06b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:12.671025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1032/2048] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:15:13.030312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3a881-fbf9-4afb-bccf-9270977be6d2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:13.032189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23f3a881-fbf9-4afb-bccf-9270977be6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:13.047231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3a881-fbf9-4afb-bccf-9270977be6d2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:13.052043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:13.053734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.054021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.054315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] PATH_INFO: `/v3/projects/1024c54cf4d44039bf5248c30cd87321` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.056200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1024c54cf4d44039bf5248c30cd87321)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:13.058514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:13.105764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1024c54cf4d44039bf5248c30cd87321', 'request_id': 'req-16343a7e-6f43-4de7-8ec5-bfaf12b04250'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:13.114055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1024c54cf4d44039bf5248c30cd87321', 'request_id': 'req-16343a7e-6f43-4de7-8ec5-bfaf12b04250'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:13.121352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1024c54cf4d44039bf5248c30cd87321', 'request_id': 'req-16343a7e-6f43-4de7-8ec5-bfaf12b04250'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:13.132915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] The token cache is being invalidate because project 1024c54cf4d44039bf5248c30cd87321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:15:13.133532 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:13.133943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-16343a7e-6f43-4de7-8ec5-bfaf12b04250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:13.135723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1017/2049] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:15:13 2022] DELETE /identity/v3/projects/1024c54cf4d44039bf5248c30cd87321 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:13.140278 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0a651-f6f7-4b7e-94a3-c951d958f41e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.140678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0a651-f6f7-4b7e-94a3-c951d958f41e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.140854 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0a651-f6f7-4b7e-94a3-c951d958f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.158668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-73d0a651-f6f7-4b7e-94a3-c951d958f41e None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:13.159872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-73d0a651-f6f7-4b7e-94a3-c951d958f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:13.221889 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1033/2050] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:13.230926 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e9825-5267-4995-bf14-5ac973001bb5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.231268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e9825-5267-4995-bf14-5ac973001bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.231568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e9825-5267-4995-bf14-5ac973001bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.251749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-499e9825-5267-4995-bf14-5ac973001bb5 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:13.252959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-499e9825-5267-4995-bf14-5ac973001bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:13.261492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1018/2051] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:13.265746 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0a651-f6f7-4b7e-94a3-c951d958f41e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:13.275930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0a651-f6f7-4b7e-94a3-c951d958f41e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:13.280521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15b35-31d0-455d-8725-f5637983ee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:13.281178 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15b35-31d0-455d-8725-f5637983ee58 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.281465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15b35-31d0-455d-8725-f5637983ee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.281770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15b35-31d0-455d-8725-f5637983ee58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.282744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15b35-31d0-455d-8725-f5637983ee58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:15:13.283057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15b35-31d0-455d-8725-f5637983ee58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:13.284644 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15b35-31d0-455d-8725-f5637983ee58 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:13.297117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1034/2052] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:15:13.301313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e9825-5267-4995-bf14-5ac973001bb5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:13.311754 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e9825-5267-4995-bf14-5ac973001bb5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:13.316474 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d23e87-aaf3-409c-8852-d2e82c72e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:13.317121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d23e87-aaf3-409c-8852-d2e82c72e52f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.317407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d23e87-aaf3-409c-8852-d2e82c72e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.317727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d23e87-aaf3-409c-8852-d2e82c72e52f admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.318867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d23e87-aaf3-409c-8852-d2e82c72e52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:13.320769 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d23e87-aaf3-409c-8852-d2e82c72e52f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:13.345833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1019/2053] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:15:13 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:13.350589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15b35-31d0-455d-8725-f5637983ee58 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:13.360557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15b35-31d0-455d-8725-f5637983ee58 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:13.372622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:13.423163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559ef64-4ad6-4482-8257-12e451d285aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:13.423828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559ef64-4ad6-4482-8257-12e451d285aa admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.424114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559ef64-4ad6-4482-8257-12e451d285aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.424390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559ef64-4ad6-4482-8257-12e451d285aa admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.425714 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559ef64-4ad6-4482-8257-12e451d285aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:13.429833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559ef64-4ad6-4482-8257-12e451d285aa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:13.449648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1035/2054] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:15:13 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:13.453638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d23e87-aaf3-409c-8852-d2e82c72e52f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:13.463892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d23e87-aaf3-409c-8852-d2e82c72e52f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:13.468468 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd69dd-0da0-4789-8c59-abc1ed6139b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:13.469123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd69dd-0da0-4789-8c59-abc1ed6139b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.469405 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd69dd-0da0-4789-8c59-abc1ed6139b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.469709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd69dd-0da0-4789-8c59-abc1ed6139b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.470436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd69dd-0da0-4789-8c59-abc1ed6139b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:13.472074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd69dd-0da0-4789-8c59-abc1ed6139b1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:13.482938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1020/2055] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:13.487322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559ef64-4ad6-4482-8257-12e451d285aa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:13.498477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559ef64-4ad6-4482-8257-12e451d285aa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:13.503191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06fdb7-a22f-4388-a07e-108f60300af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:13.503880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06fdb7-a22f-4388-a07e-108f60300af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.504169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06fdb7-a22f-4388-a07e-108f60300af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.504454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06fdb7-a22f-4388-a07e-108f60300af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.505434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06fdb7-a22f-4388-a07e-108f60300af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:13.507087 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06fdb7-a22f-4388-a07e-108f60300af6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:13.517685 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1036/2056] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:13.522764 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd69dd-0da0-4789-8c59-abc1ed6139b1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:13.533380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd69dd-0da0-4789-8c59-abc1ed6139b1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:13.539017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902112-1eb9-4292-aff4-029d0ebc6689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:13.539917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902112-1eb9-4292-aff4-029d0ebc6689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.540201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902112-1eb9-4292-aff4-029d0ebc6689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.540479 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b902112-1eb9-4292-aff4-029d0ebc6689 admin admin] PATH_INFO: `/v3/projects/2ca28f17bfeb4bc6ad8444182f4ad048/users/c4f4604d203640e58297cb491aff59fa/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.542756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:13.557882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b902112-1eb9-4292-aff4-029d0ebc6689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca28f17bfeb4bc6ad8444182f4ad048, user_id=c4f4604d203640e58297cb491aff59fa, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:13.560602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b902112-1eb9-4292-aff4-029d0ebc6689 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:13.574200 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1021/2057] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:15:13 2022] PUT /identity/v3/projects/2ca28f17bfeb4bc6ad8444182f4ad048/users/c4f4604d203640e58297cb491aff59fa/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:13.579310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a89244-4867-4ca5-9adf-c8d976125779 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.579679 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a89244-4867-4ca5-9adf-c8d976125779 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.580055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a89244-4867-4ca5-9adf-c8d976125779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.598085 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c3a89244-4867-4ca5-9adf-c8d976125779 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:13.600111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3a89244-4867-4ca5-9adf-c8d976125779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:13.658604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1037/2058] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:13.668829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902112-1eb9-4292-aff4-029d0ebc6689 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:13.670629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4b902112-1eb9-4292-aff4-029d0ebc6689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:13.733668 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b902112-1eb9-4292-aff4-029d0ebc6689 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:13.737302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912679-30e2-4099-89f9-1096d7164713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:13.737985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912679-30e2-4099-89f9-1096d7164713 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:13.738274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912679-30e2-4099-89f9-1096d7164713 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:13.738554 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912679-30e2-4099-89f9-1096d7164713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:13.748148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60912679-30e2-4099-89f9-1096d7164713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:13.749637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60912679-30e2-4099-89f9-1096d7164713 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:13.759225 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1022/2059] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:15:14.415674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf4193-4092-48a8-8037-5b54b5b88bbe None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:14.416195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf4193-4092-48a8-8037-5b54b5b88bbe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:14.416289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf4193-4092-48a8-8037-5b54b5b88bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:14.445720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-79cf4193-4092-48a8-8037-5b54b5b88bbe None None] MFA Rules not processed for user `c4f4604d203640e58297cb491aff59fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:14.446934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-79cf4193-4092-48a8-8037-5b54b5b88bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:14.514605 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1038/2060] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:14.526029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912679-30e2-4099-89f9-1096d7164713 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:14.527449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-60912679-30e2-4099-89f9-1096d7164713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:14.592080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912679-30e2-4099-89f9-1096d7164713 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:14.595876 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a84aa-60c7-4592-b928-aab259fcdaa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:14.596596 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a84aa-60c7-4592-b928-aab259fcdaa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:14.596961 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a84aa-60c7-4592-b928-aab259fcdaa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:14.597318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a84aa-60c7-4592-b928-aab259fcdaa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:14.607409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a84aa-60c7-4592-b928-aab259fcdaa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:14.608840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a84aa-60c7-4592-b928-aab259fcdaa3 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:14.618364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1023/2061] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:15:18.058490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597f83-7847-4804-a249-d306330b4780 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:18.058977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597f83-7847-4804-a249-d306330b4780 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:18.059580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597f83-7847-4804-a249-d306330b4780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:18.077261 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6a597f83-7847-4804-a249-d306330b4780 None None] MFA Rules not processed for user `c4f4604d203640e58297cb491aff59fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:18.078493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6a597f83-7847-4804-a249-d306330b4780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:18.086557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1039/2062] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:24.613640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:28.072037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:48.610611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a84aa-60c7-4592-b928-aab259fcdaa3 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:48.612165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-780a84aa-60c7-4592-b928-aab259fcdaa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:48.701009 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a84aa-60c7-4592-b928-aab259fcdaa3 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:48.705744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:48.706613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:48.706901 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:48.707184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] PATH_INFO: `/v3/users/ad3e04b4e8c94f95a65a2fc453a015c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:48.708391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3e04b4e8c94f95a65a2fc453a015c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:48.710399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:48.760296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3e04b4e8c94f95a65a2fc453a015c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:48.772440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3e04b4e8c94f95a65a2fc453a015c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:48.779847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3e04b4e8c94f95a65a2fc453a015c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:48.786907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3e04b4e8c94f95a65a2fc453a015c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:48.787541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3e04b4e8c94f95a65a2fc453a015c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:48.794508 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1024/2063] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:15:48 2022] DELETE /identity/v3/users/ad3e04b4e8c94f95a65a2fc453a015c4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:15:48.798981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae800c-0516-4d8a-8e21-3230e5aaf2fa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:48.799466 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae800c-0516-4d8a-8e21-3230e5aaf2fa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:48.799730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae800c-0516-4d8a-8e21-3230e5aaf2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:48.830055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dfae800c-0516-4d8a-8e21-3230e5aaf2fa None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:48.831306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dfae800c-0516-4d8a-8e21-3230e5aaf2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:48.892773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1040/2064] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:48.904784 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:48.906227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:49.000287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:49.021540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e73c8-2864-4994-a3e8-ed8eccb20b4d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:49.026051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df8bf-f048-4cf0-9fcb-3f345da8d525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:49.026700 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df8bf-f048-4cf0-9fcb-3f345da8d525 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:49.026985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df8bf-f048-4cf0-9fcb-3f345da8d525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:49.027266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15df8bf-f048-4cf0-9fcb-3f345da8d525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:49.036569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15df8bf-f048-4cf0-9fcb-3f345da8d525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:49.038034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15df8bf-f048-4cf0-9fcb-3f345da8d525 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:49.047559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1025/2065] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:15:49.302225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae800c-0516-4d8a-8e21-3230e5aaf2fa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:49.304080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dfae800c-0516-4d8a-8e21-3230e5aaf2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:49.318616 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae800c-0516-4d8a-8e21-3230e5aaf2fa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:49.323815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df8bf-f048-4cf0-9fcb-3f345da8d525 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:49.324819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:49.325186 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b15df8bf-f048-4cf0-9fcb-3f345da8d525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:49.325883 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:49.326231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:49.326571 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] PATH_INFO: `/v3/users/ec499fa15e944f58b837880863e1d33e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:49.327851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec499fa15e944f58b837880863e1d33e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:49.329878 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:49.340170 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15df8bf-f048-4cf0-9fcb-3f345da8d525 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:49.345841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:49.346995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:49.347389 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:49.347677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] PATH_INFO: `/v3/projects/b34a26d69ffe4ab3a2e8342ea9b078cb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:49.349159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34a26d69ffe4ab3a2e8342ea9b078cb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:49.351357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:49.398095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec499fa15e944f58b837880863e1d33e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.408838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34a26d69ffe4ab3a2e8342ea9b078cb', 'request_id': 'req-a57a7f4d-8b53-4c10-943b-26fdf852da1e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.414835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec499fa15e944f58b837880863e1d33e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.417454 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34a26d69ffe4ab3a2e8342ea9b078cb', 'request_id': 'req-a57a7f4d-8b53-4c10-943b-26fdf852da1e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.425065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34a26d69ffe4ab3a2e8342ea9b078cb', 'request_id': 'req-a57a7f4d-8b53-4c10-943b-26fdf852da1e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.430465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec499fa15e944f58b837880863e1d33e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.431210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec499fa15e944f58b837880863e1d33e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.431815 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec499fa15e944f58b837880863e1d33e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.439463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] The token cache is being invalidate because project b34a26d69ffe4ab3a2e8342ea9b078cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:15:49.439842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.440557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a57a7f4d-8b53-4c10-943b-26fdf852da1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:49.442762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1026/2066] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:15:49 2022] DELETE /identity/v3/projects/b34a26d69ffe4ab3a2e8342ea9b078cb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:15:49.451634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1041/2067] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:15:49 2022] DELETE /identity/v3/users/ec499fa15e944f58b837880863e1d33e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:49.459271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f25f-3fbc-4356-a867-2a1ee548c7a1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:49.459618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f25f-3fbc-4356-a867-2a1ee548c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:49.460359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f25f-3fbc-4356-a867-2a1ee548c7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:49.483588 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2d64f25f-3fbc-4356-a867-2a1ee548c7a1 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:49.485057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2d64f25f-3fbc-4356-a867-2a1ee548c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:49.557744 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1027/2068] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:49.570072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:49.572121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:49.642035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebf081-be7e-4676-afb8-8cfdacb71b81 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:49.645617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f705-cfc1-453a-b66e-a7c3cd99e8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:49.646284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f705-cfc1-453a-b66e-a7c3cd99e8cc service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:49.646553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f705-cfc1-453a-b66e-a7c3cd99e8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:49.646851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f705-cfc1-453a-b66e-a7c3cd99e8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:49.658130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5f705-cfc1-453a-b66e-a7c3cd99e8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:49.659562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5f705-cfc1-453a-b66e-a7c3cd99e8cc service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:49.669285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1042/2069] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:15:49.986693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f25f-3fbc-4356-a867-2a1ee548c7a1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:49.988146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2d64f25f-3fbc-4356-a867-2a1ee548c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:50.006545 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f25f-3fbc-4356-a867-2a1ee548c7a1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:50.011451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:50.012321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.012606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.013091 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] PATH_INFO: `/v3/projects/b7fedc0dd96c4abea87e3c3bbd87acd8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.014267 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fedc0dd96c4abea87e3c3bbd87acd8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:50.016175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:50.068745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fedc0dd96c4abea87e3c3bbd87acd8', 'request_id': 'req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:50.076886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fedc0dd96c4abea87e3c3bbd87acd8', 'request_id': 'req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:50.078187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:50.091886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fedc0dd96c4abea87e3c3bbd87acd8', 'request_id': 'req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:50.109930 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] The token cache is being invalidate because project b7fedc0dd96c4abea87e3c3bbd87acd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:15:50.110303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:50.111034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e5dfb30-d5fd-466b-817d-18e5f38d13c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:50.112867 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1028/2070] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:15:49 2022] DELETE /identity/v3/projects/b7fedc0dd96c4abea87e3c3bbd87acd8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:50.117675 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31f1e5-fbd6-4a96-9c3f-51dced3fd5c4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.118169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31f1e5-fbd6-4a96-9c3f-51dced3fd5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.118343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31f1e5-fbd6-4a96-9c3f-51dced3fd5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.130382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:50.166732 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fc31f1e5-fbd6-4a96-9c3f-51dced3fd5c4 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:50.168120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fc31f1e5-fbd6-4a96-9c3f-51dced3fd5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:50.228830 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1043/2071] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:15:50.238213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3f501-1d1d-4a33-969a-bc028f08946b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.238534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3f501-1d1d-4a33-969a-bc028f08946b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.238811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3f501-1d1d-4a33-969a-bc028f08946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.257191 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-56f3f501-1d1d-4a33-969a-bc028f08946b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:50.258984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-56f3f501-1d1d-4a33-969a-bc028f08946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:50.266956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1029/2072] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:50.271314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31f1e5-fbd6-4a96-9c3f-51dced3fd5c4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:50.282232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31f1e5-fbd6-4a96-9c3f-51dced3fd5c4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:50.287208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf32599-1f8e-4944-82ad-f9f7048cb260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:50.287864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32599-1f8e-4944-82ad-f9f7048cb260 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.288147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32599-1f8e-4944-82ad-f9f7048cb260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.288422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32599-1f8e-4944-82ad-f9f7048cb260 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.289208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf32599-1f8e-4944-82ad-f9f7048cb260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:15:50.289733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf32599-1f8e-4944-82ad-f9f7048cb260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:50.291147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf32599-1f8e-4944-82ad-f9f7048cb260 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:50.303550 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1044/2073] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:15:50.308057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3f501-1d1d-4a33-969a-bc028f08946b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:50.318959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3f501-1d1d-4a33-969a-bc028f08946b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:50.324395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab3387-9eb4-4db6-b361-8875b909a64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:50.325047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3387-9eb4-4db6-b361-8875b909a64e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.325329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3387-9eb4-4db6-b361-8875b909a64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.325661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3387-9eb4-4db6-b361-8875b909a64e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.326356 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab3387-9eb4-4db6-b361-8875b909a64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:50.328244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab3387-9eb4-4db6-b361-8875b909a64e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:50.354843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1030/2074] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:15:50 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:50.359104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf32599-1f8e-4944-82ad-f9f7048cb260 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:50.369384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf32599-1f8e-4944-82ad-f9f7048cb260 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:50.428984 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f56c8-8bd7-4ca5-84c7-926e3d4c9cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:50.430615 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f56c8-8bd7-4ca5-84c7-926e3d4c9cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.430879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f56c8-8bd7-4ca5-84c7-926e3d4c9cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.431157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f56c8-8bd7-4ca5-84c7-926e3d4c9cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.431845 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f56c8-8bd7-4ca5-84c7-926e3d4c9cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:50.433781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f56c8-8bd7-4ca5-84c7-926e3d4c9cc0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:50.453651 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1045/2075] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:15:50 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:50.457873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab3387-9eb4-4db6-b361-8875b909a64e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:50.468590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab3387-9eb4-4db6-b361-8875b909a64e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:50.473126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728298a9-a166-4aca-9ee5-e65c17768660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:50.473806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728298a9-a166-4aca-9ee5-e65c17768660 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.474088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728298a9-a166-4aca-9ee5-e65c17768660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.474363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728298a9-a166-4aca-9ee5-e65c17768660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.475078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728298a9-a166-4aca-9ee5-e65c17768660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:50.476783 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728298a9-a166-4aca-9ee5-e65c17768660 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:50.488635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1031/2076] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:50.492768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f56c8-8bd7-4ca5-84c7-926e3d4c9cc0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:50.502831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f56c8-8bd7-4ca5-84c7-926e3d4c9cc0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:50.507468 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa82708-24ee-49a5-a74d-068b24b0ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:50.508627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82708-24ee-49a5-a74d-068b24b0ed61 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.508975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82708-24ee-49a5-a74d-068b24b0ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.509260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82708-24ee-49a5-a74d-068b24b0ed61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.510042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa82708-24ee-49a5-a74d-068b24b0ed61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:50.512536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa82708-24ee-49a5-a74d-068b24b0ed61 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:50.525626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1046/2077] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:50.529506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728298a9-a166-4aca-9ee5-e65c17768660 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:50.539916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728298a9-a166-4aca-9ee5-e65c17768660 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:50.544477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db440bd-a7f8-4e0f-9992-6d15f642aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:50.545343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db440bd-a7f8-4e0f-9992-6d15f642aa31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.545656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db440bd-a7f8-4e0f-9992-6d15f642aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.545927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db440bd-a7f8-4e0f-9992-6d15f642aa31 admin admin] PATH_INFO: `/v3/projects/d90b5dff6cf54c7c8f0f5e18f9ad7b19/users/b973a23056a94356a1180e70ed2ed605/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.560650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db440bd-a7f8-4e0f-9992-6d15f642aa31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90b5dff6cf54c7c8f0f5e18f9ad7b19, user_id=b973a23056a94356a1180e70ed2ed605, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:50.563424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db440bd-a7f8-4e0f-9992-6d15f642aa31 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:50.576575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1032/2078] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:15:50 2022] PUT /identity/v3/projects/d90b5dff6cf54c7c8f0f5e18f9ad7b19/users/b973a23056a94356a1180e70ed2ed605/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:50.587971 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cc7be-e9c2-4d38-bd33-3d648f59ffd0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.588296 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cc7be-e9c2-4d38-bd33-3d648f59ffd0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.588581 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cc7be-e9c2-4d38-bd33-3d648f59ffd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.615624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-807cc7be-e9c2-4d38-bd33-3d648f59ffd0 None None] MFA Rules not processed for user `b973a23056a94356a1180e70ed2ed605`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:50.616827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-807cc7be-e9c2-4d38-bd33-3d648f59ffd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:50.665564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:50.684773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1047/2079] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:50.695948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db440bd-a7f8-4e0f-9992-6d15f642aa31 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:50.697823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6db440bd-a7f8-4e0f-9992-6d15f642aa31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:50.754808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db440bd-a7f8-4e0f-9992-6d15f642aa31 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:50.759443 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b864-8a77-40c2-b7c2-c4b81b647a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:50.760021 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b864-8a77-40c2-b7c2-c4b81b647a51 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:50.760301 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b864-8a77-40c2-b7c2-c4b81b647a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:50.760573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085b864-8a77-40c2-b7c2-c4b81b647a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:50.769386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b864-8a77-40c2-b7c2-c4b81b647a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:50.770836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085b864-8a77-40c2-b7c2-c4b81b647a51 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:50.780702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1033/2080] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:15:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:15:53.205837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5ff68-38e3-4b55-a584-d4a8bda5a825 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:53.206354 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5ff68-38e3-4b55-a584-d4a8bda5a825 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:53.206448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5ff68-38e3-4b55-a584-d4a8bda5a825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:53.223965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-24f5ff68-38e3-4b55-a584-d4a8bda5a825 None None] MFA Rules not processed for user `b973a23056a94356a1180e70ed2ed605`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:53.225161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-24f5ff68-38e3-4b55-a584-d4a8bda5a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:53.232592 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1048/2081] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:58.825915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b864-8a77-40c2-b7c2-c4b81b647a51 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:58.827522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8085b864-8a77-40c2-b7c2-c4b81b647a51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:58.902913 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085b864-8a77-40c2-b7c2-c4b81b647a51 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:58.908041 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:58.908952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:58.909256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:58.909697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] PATH_INFO: `/v3/users/f8b281f5fe3847fb8f744894b73e7b81` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:58.910927 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b281f5fe3847fb8f744894b73e7b81)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:58.912923 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:58.945607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:58.967649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b281f5fe3847fb8f744894b73e7b81'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:58.980293 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b281f5fe3847fb8f744894b73e7b81'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:58.987730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b281f5fe3847fb8f744894b73e7b81'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:58.995302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b281f5fe3847fb8f744894b73e7b81'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:58.995947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-92f462dc-c697-4008-b19e-a7a8b72fbd92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b281f5fe3847fb8f744894b73e7b81'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:59.001899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1034/2082] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:15:58 2022] DELETE /identity/v3/users/f8b281f5fe3847fb8f744894b73e7b81 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:59.250855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5ff68-38e3-4b55-a584-d4a8bda5a825 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:59.264930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5ff68-38e3-4b55-a584-d4a8bda5a825 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:59.352987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:59.354109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:59.354462 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:59.354807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] PATH_INFO: `/v3/projects/1d3375c9a37043308905b8613f2267f8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:59.356081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3375c9a37043308905b8613f2267f8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:59.359222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:59.427674 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3375c9a37043308905b8613f2267f8', 'request_id': 'req-e2516723-1003-4e4f-9a02-6ce5dc27a531'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:59.434989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3375c9a37043308905b8613f2267f8', 'request_id': 'req-e2516723-1003-4e4f-9a02-6ce5dc27a531'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:59.441515 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3375c9a37043308905b8613f2267f8', 'request_id': 'req-e2516723-1003-4e4f-9a02-6ce5dc27a531'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:59.463970 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] The token cache is being invalidate because project 1d3375c9a37043308905b8613f2267f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:15:59.464307 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:59.464986 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2516723-1003-4e4f-9a02-6ce5dc27a531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:15:59.466786 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1049/2083] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:15:59 2022] DELETE /identity/v3/projects/1d3375c9a37043308905b8613f2267f8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:15:59.472079 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbb1cf-4187-478c-b6bc-b80296fba332 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:59.473190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbb1cf-4187-478c-b6bc-b80296fba332 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:59.473568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbb1cf-4187-478c-b6bc-b80296fba332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:59.509434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-63bbb1cf-4187-478c-b6bc-b80296fba332 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:59.510992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-63bbb1cf-4187-478c-b6bc-b80296fba332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:59.593524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1035/2084] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:59.597926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71bc5-517f-4a14-a686-67cfcb3346b9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:59.597926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71bc5-517f-4a14-a686-67cfcb3346b9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:59.598191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71bc5-517f-4a14-a686-67cfcb3346b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:59.618304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-13c71bc5-517f-4a14-a686-67cfcb3346b9 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:15:59.619870 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-13c71bc5-517f-4a14-a686-67cfcb3346b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:15:59.630712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1050/2085] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:15:59.635751 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbb1cf-4187-478c-b6bc-b80296fba332 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:59.646373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbb1cf-4187-478c-b6bc-b80296fba332 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:59.651417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f603b4-c9c8-43d5-8ed8-c87e773f708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:59.652181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f603b4-c9c8-43d5-8ed8-c87e773f708d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:59.652639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f603b4-c9c8-43d5-8ed8-c87e773f708d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:59.652984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f603b4-c9c8-43d5-8ed8-c87e773f708d admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:59.653855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f603b4-c9c8-43d5-8ed8-c87e773f708d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:15:59.654235 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f603b4-c9c8-43d5-8ed8-c87e773f708d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:59.655836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f603b4-c9c8-43d5-8ed8-c87e773f708d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:59.668954 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1036/2086] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:15:59.673579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c71bc5-517f-4a14-a686-67cfcb3346b9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:59.685810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c71bc5-517f-4a14-a686-67cfcb3346b9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:59.700730 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be71a3-8455-4bfb-abb2-712664e6f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:59.701279 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be71a3-8455-4bfb-abb2-712664e6f874 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:59.701611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be71a3-8455-4bfb-abb2-712664e6f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:59.701989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be71a3-8455-4bfb-abb2-712664e6f874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:59.702707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be71a3-8455-4bfb-abb2-712664e6f874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:59.704622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be71a3-8455-4bfb-abb2-712664e6f874 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:59.736505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1051/2087] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:15:59 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:59.740194 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f603b4-c9c8-43d5-8ed8-c87e773f708d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:59.751983 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f603b4-c9c8-43d5-8ed8-c87e773f708d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:59.833074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0087c-dcc5-4e1f-b27b-84024d4d241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:59.833850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0087c-dcc5-4e1f-b27b-84024d4d241d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:59.834111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0087c-dcc5-4e1f-b27b-84024d4d241d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:59.834366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0087c-dcc5-4e1f-b27b-84024d4d241d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:59.835075 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0087c-dcc5-4e1f-b27b-84024d4d241d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:59.837090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0087c-dcc5-4e1f-b27b-84024d4d241d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:59.883340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1037/2088] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:15:59 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:15:59.888086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be71a3-8455-4bfb-abb2-712664e6f874 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:59.906283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be71a3-8455-4bfb-abb2-712664e6f874 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:59.913764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d438400-525d-4ddd-b5e7-1eb30f3ce4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:59.914926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d438400-525d-4ddd-b5e7-1eb30f3ce4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:59.915273 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d438400-525d-4ddd-b5e7-1eb30f3ce4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:59.915623 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d438400-525d-4ddd-b5e7-1eb30f3ce4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:59.916564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d438400-525d-4ddd-b5e7-1eb30f3ce4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:59.918381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d438400-525d-4ddd-b5e7-1eb30f3ce4e4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:59.934899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1052/2089] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:15:59.936767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0087c-dcc5-4e1f-b27b-84024d4d241d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:15:59.956374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0087c-dcc5-4e1f-b27b-84024d4d241d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:15:59.962710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb22ab-16a2-48cc-9dcf-176fbb5f52e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:15:59.964154 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb22ab-16a2-48cc-9dcf-176fbb5f52e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:15:59.964438 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb22ab-16a2-48cc-9dcf-176fbb5f52e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:15:59.964722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb22ab-16a2-48cc-9dcf-176fbb5f52e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:15:59.965887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb22ab-16a2-48cc-9dcf-176fbb5f52e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:15:59.969951 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb22ab-16a2-48cc-9dcf-176fbb5f52e1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:15:59.975406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:15:59.983516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1038/2090] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:15:59.988143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d438400-525d-4ddd-b5e7-1eb30f3ce4e4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:00.001348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d438400-525d-4ddd-b5e7-1eb30f3ce4e4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:00.010173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f4b5c-651b-4a80-9c49-65935d59e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:00.011077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f4b5c-651b-4a80-9c49-65935d59e20c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.011359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f4b5c-651b-4a80-9c49-65935d59e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.011632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f4b5c-651b-4a80-9c49-65935d59e20c admin admin] PATH_INFO: `/v3/projects/310a751b2a744c468555e802f633a523/users/43c4a47c94e34362ba755b089b019440/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.029526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f4b5c-651b-4a80-9c49-65935d59e20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=310a751b2a744c468555e802f633a523, user_id=43c4a47c94e34362ba755b089b019440, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:00.032694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f4b5c-651b-4a80-9c49-65935d59e20c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:00.050699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1053/2091] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:15:59 2022] PUT /identity/v3/projects/310a751b2a744c468555e802f633a523/users/43c4a47c94e34362ba755b089b019440/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:16:00.061716 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3d66b-e85a-416b-9e60-66ae25230c12 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.062004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3d66b-e85a-416b-9e60-66ae25230c12 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.062282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3d66b-e85a-416b-9e60-66ae25230c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.092809 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-88a3d66b-e85a-416b-9e60-66ae25230c12 None None] MFA Rules not processed for user `43c4a47c94e34362ba755b089b019440`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:00.094053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88a3d66b-e85a-416b-9e60-66ae25230c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:00.165452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1039/2092] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:00.169934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f4b5c-651b-4a80-9c49-65935d59e20c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:00.181086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:00.239521 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f4b5c-651b-4a80-9c49-65935d59e20c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:00.244865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa2747-ecff-47dc-a52a-8267869ea34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:00.245543 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa2747-ecff-47dc-a52a-8267869ea34d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.245826 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa2747-ecff-47dc-a52a-8267869ea34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.246101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa2747-ecff-47dc-a52a-8267869ea34d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.246781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa2747-ecff-47dc-a52a-8267869ea34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:00.248681 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa2747-ecff-47dc-a52a-8267869ea34d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:00.278245 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1054/2093] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:16:00 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:16:00.279328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3d66b-e85a-416b-9e60-66ae25230c12 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:00.291010 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3d66b-e85a-416b-9e60-66ae25230c12 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:00.364011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc85a34-c961-4c07-9837-a63d2abe98f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:00.364788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85a34-c961-4c07-9837-a63d2abe98f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.365185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85a34-c961-4c07-9837-a63d2abe98f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.365569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85a34-c961-4c07-9837-a63d2abe98f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.366494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc85a34-c961-4c07-9837-a63d2abe98f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:00.369510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc85a34-c961-4c07-9837-a63d2abe98f0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:00.396822 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1040/2094] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:16:00 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:16:00.402132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa2747-ecff-47dc-a52a-8267869ea34d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:00.415577 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa2747-ecff-47dc-a52a-8267869ea34d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:00.422770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ccc8d-abb8-429e-b8fc-78ad90b0561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:00.423725 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ccc8d-abb8-429e-b8fc-78ad90b0561a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.425928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ccc8d-abb8-429e-b8fc-78ad90b0561a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.426445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ccc8d-abb8-429e-b8fc-78ad90b0561a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.427204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ccc8d-abb8-429e-b8fc-78ad90b0561a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:00.429868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ccc8d-abb8-429e-b8fc-78ad90b0561a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:00.445285 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1055/2095] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:00.449260 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc85a34-c961-4c07-9837-a63d2abe98f0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:00.463443 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc85a34-c961-4c07-9837-a63d2abe98f0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:00.470660 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2f76e-6b6e-40e8-befb-57c4b9e79bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:00.471623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2f76e-6b6e-40e8-befb-57c4b9e79bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.471917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2f76e-6b6e-40e8-befb-57c4b9e79bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.472255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2f76e-6b6e-40e8-befb-57c4b9e79bc5 admin admin] PATH_INFO: `/v3/projects/30cb36fad4944cbf9bb72ade29d7f03e/users/b4254dbfe0ca4735ad988aef2c6bcdf4/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.497018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2f76e-6b6e-40e8-befb-57c4b9e79bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cb36fad4944cbf9bb72ade29d7f03e, user_id=b4254dbfe0ca4735ad988aef2c6bcdf4, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:00.500339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2f76e-6b6e-40e8-befb-57c4b9e79bc5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:00.534252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1041/2096] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:16:00 2022] PUT /identity/v3/projects/30cb36fad4944cbf9bb72ade29d7f03e/users/b4254dbfe0ca4735ad988aef2c6bcdf4/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:16:00.538053 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ccc8d-abb8-429e-b8fc-78ad90b0561a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:00.552259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ccc8d-abb8-429e-b8fc-78ad90b0561a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:00.566203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e371b38-71dc-4ccf-a2e1-3655670fe4a3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.566490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e371b38-71dc-4ccf-a2e1-3655670fe4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.566768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e371b38-71dc-4ccf-a2e1-3655670fe4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.586112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1e371b38-71dc-4ccf-a2e1-3655670fe4a3 None None] MFA Rules not processed for user `c4f4604d203640e58297cb491aff59fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:00.587469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1e371b38-71dc-4ccf-a2e1-3655670fe4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:00.635692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40696b-083a-4a80-a8ec-f1dd720a001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:00.636664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40696b-083a-4a80-a8ec-f1dd720a001d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.636993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40696b-083a-4a80-a8ec-f1dd720a001d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.637301 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40696b-083a-4a80-a8ec-f1dd720a001d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.638084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40696b-083a-4a80-a8ec-f1dd720a001d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:00.638301 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:00.639827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40696b-083a-4a80-a8ec-f1dd720a001d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:00.652393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1056/2097] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:00.656126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40696b-083a-4a80-a8ec-f1dd720a001d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:00.657617 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1042/2098] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:16:00.668034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40696b-083a-4a80-a8ec-f1dd720a001d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:00.673005 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b93f8-252e-4440-8266-12777601965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:00.674033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b93f8-252e-4440-8266-12777601965b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.674422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b93f8-252e-4440-8266-12777601965b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.674770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b93f8-252e-4440-8266-12777601965b admin admin] PATH_INFO: `/v3/projects/30cb36fad4944cbf9bb72ade29d7f03e/users/b4254dbfe0ca4735ad988aef2c6bcdf4/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.676843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b93f8-252e-4440-8266-12777601965b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cb36fad4944cbf9bb72ade29d7f03e, user_id=b4254dbfe0ca4735ad988aef2c6bcdf4, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:00.681884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b93f8-252e-4440-8266-12777601965b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:00.693544 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1057/2099] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:16:00 2022] PUT /identity/v3/projects/30cb36fad4944cbf9bb72ade29d7f03e/users/b4254dbfe0ca4735ad988aef2c6bcdf4/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:16:00.704077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955c33f-0dcc-4b72-a8b4-b1946ca41bf1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.704366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955c33f-0dcc-4b72-a8b4-b1946ca41bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.704644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955c33f-0dcc-4b72-a8b4-b1946ca41bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.735755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2955c33f-0dcc-4b72-a8b4-b1946ca41bf1 None None] MFA Rules not processed for user `b4254dbfe0ca4735ad988aef2c6bcdf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:00.736999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2955c33f-0dcc-4b72-a8b4-b1946ca41bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:00.814016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1043/2100] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:00.826448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b93f8-252e-4440-8266-12777601965b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:00.828151 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-939b93f8-252e-4440-8266-12777601965b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:00.888096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b93f8-252e-4440-8266-12777601965b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:00.892085 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe5afd-12dc-403c-ae2b-d78b5f413d92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:00.892738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe5afd-12dc-403c-ae2b-d78b5f413d92 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:00.893025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe5afd-12dc-403c-ae2b-d78b5f413d92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:00.893331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe5afd-12dc-403c-ae2b-d78b5f413d92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:00.903518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe5afd-12dc-403c-ae2b-d78b5f413d92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:00.904948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe5afd-12dc-403c-ae2b-d78b5f413d92 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:00.915531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1058/2101] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:16:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:16:00.988770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955c33f-0dcc-4b72-a8b4-b1946ca41bf1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:00.998236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955c33f-0dcc-4b72-a8b4-b1946ca41bf1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:01.001842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdc9ce-55a4-42d5-ae2d-c5f7a26a90d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:01.002480 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdc9ce-55a4-42d5-ae2d-c5f7a26a90d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:01.002767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdc9ce-55a4-42d5-ae2d-c5f7a26a90d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:01.003050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdc9ce-55a4-42d5-ae2d-c5f7a26a90d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:01.066078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdc9ce-55a4-42d5-ae2d-c5f7a26a90d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:01.067441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdc9ce-55a4-42d5-ae2d-c5f7a26a90d5 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:01.082666 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1044/2102] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:16:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:16:10.910499 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:11.076000 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=62 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:34.311855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b249-d7d1-4c61-a7e1-ed17bbe515ee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:34.312358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b249-d7d1-4c61-a7e1-ed17bbe515ee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:34.312701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7b249-d7d1-4c61-a7e1-ed17bbe515ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:34.394066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d6e7b249-d7d1-4c61-a7e1-ed17bbe515ee None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:34.395390 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d6e7b249-d7d1-4c61-a7e1-ed17bbe515ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:34.472358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1059/2103] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:16:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:16:34.511995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdc9ce-55a4-42d5-ae2d-c5f7a26a90d5 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:34.513452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1dfdc9ce-55a4-42d5-ae2d-c5f7a26a90d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:34.582885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdc9ce-55a4-42d5-ae2d-c5f7a26a90d5 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:34.587869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c9211-43ce-40b7-b935-f1862b85ef60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:34.589067 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c9211-43ce-40b7-b935-f1862b85ef60 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:34.589354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c9211-43ce-40b7-b935-f1862b85ef60 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:34.589662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c9211-43ce-40b7-b935-f1862b85ef60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:34.597708 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c9211-43ce-40b7-b935-f1862b85ef60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:34.599428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c9211-43ce-40b7-b935-f1862b85ef60 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:34.607570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1045/2104] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:16:35.210689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09641-71f7-443c-a46e-55af4e1c79d2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:35.211023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09641-71f7-443c-a46e-55af4e1c79d2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:35.211454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09641-71f7-443c-a46e-55af4e1c79d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:35.236077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-11d09641-71f7-443c-a46e-55af4e1c79d2 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:35.237752 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11d09641-71f7-443c-a46e-55af4e1c79d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:35.251729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1060/2105] 10.222.0.90 () {58 vars in 967 bytes} [Tue Jun 21 15:16:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:35.268851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c9211-43ce-40b7-b935-f1862b85ef60 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:35.293699 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c9211-43ce-40b7-b935-f1862b85ef60 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:35.299569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882e49d-42ff-47dd-8357-0b615f3f8034 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:35.300221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882e49d-42ff-47dd-8357-0b615f3f8034 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:35.300501 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882e49d-42ff-47dd-8357-0b615f3f8034 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:35.300775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882e49d-42ff-47dd-8357-0b615f3f8034 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:35.310671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882e49d-42ff-47dd-8357-0b615f3f8034 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:35.312348 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882e49d-42ff-47dd-8357-0b615f3f8034 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:35.321953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1046/2106] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:16:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:16:35.597842 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a65f-d9f6-497d-91e6-3e104103a5f3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:35.598377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a65f-d9f6-497d-91e6-3e104103a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:35.598500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9a65f-d9f6-497d-91e6-3e104103a5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:35.625057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d1f9a65f-d9f6-497d-91e6-3e104103a5f3 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:35.627044 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d1f9a65f-d9f6-497d-91e6-3e104103a5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:35.638132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1061/2107] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:16:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:35.659444 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882e49d-42ff-47dd-8357-0b615f3f8034 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:35.672043 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882e49d-42ff-47dd-8357-0b615f3f8034 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:35.679998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7523-d996-4330-b822-89489c4bde48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:35.681562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7523-d996-4330-b822-89489c4bde48 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:35.682324 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7523-d996-4330-b822-89489c4bde48 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:35.682767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7523-d996-4330-b822-89489c4bde48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:35.703006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d7523-d996-4330-b822-89489c4bde48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:35.703006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d7523-d996-4330-b822-89489c4bde48 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:35.709652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1047/2108] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:16:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:16:36.165105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d19e48-5ebb-4959-b937-1413a15a2139 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:36.165398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d19e48-5ebb-4959-b937-1413a15a2139 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:36.165707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d19e48-5ebb-4959-b937-1413a15a2139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:36.183840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a3d19e48-5ebb-4959-b937-1413a15a2139 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:36.185050 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3d19e48-5ebb-4959-b937-1413a15a2139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:36.192306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1062/2109] 10.222.0.90 () {58 vars in 967 bytes} [Tue Jun 21 15:16:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:36.206030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7523-d996-4330-b822-89489c4bde48 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:36.217911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7523-d996-4330-b822-89489c4bde48 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:36.225102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e44fb9-7bca-4551-9516-1892b1a05541 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:36.226052 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e44fb9-7bca-4551-9516-1892b1a05541 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:36.226339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e44fb9-7bca-4551-9516-1892b1a05541 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:36.226616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e44fb9-7bca-4551-9516-1892b1a05541 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:36.240673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e44fb9-7bca-4551-9516-1892b1a05541 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:36.242568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e44fb9-7bca-4551-9516-1892b1a05541 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:36.255541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1048/2110] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:16:36.308546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d19e48-5ebb-4959-b937-1413a15a2139 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:36.310830 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3d19e48-5ebb-4959-b937-1413a15a2139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:36.472570 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d19e48-5ebb-4959-b937-1413a15a2139 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:36.479457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:36.480517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:36.480945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:36.481405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:36.483602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:36.497829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:36.499596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:36.515000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1063/2111] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:16:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:16:36.708220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda66bd-7f60-4048-a97f-46794d6d53f6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:36.708961 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda66bd-7f60-4048-a97f-46794d6d53f6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:36.709261 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda66bd-7f60-4048-a97f-46794d6d53f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:36.737865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ceda66bd-7f60-4048-a97f-46794d6d53f6 None None] MFA Rules not processed for user `ee7a49315d634014bc8e89b33c6355d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:36.740044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ceda66bd-7f60-4048-a97f-46794d6d53f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:36.830563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1049/2112] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:38.577004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:38.578618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:38.593464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:38.664393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086757f-d7ef-4cff-9b4b-9ab2c55300cd service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:38.669961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:38.670923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:38.671281 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:38.671636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] PATH_INFO: `/v3/users/b973a23056a94356a1180e70ed2ed605` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:38.672973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b973a23056a94356a1180e70ed2ed605)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:38.675528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:38.769563 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b973a23056a94356a1180e70ed2ed605'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:38.786012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b973a23056a94356a1180e70ed2ed605'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:38.805629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b973a23056a94356a1180e70ed2ed605'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:38.807572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b973a23056a94356a1180e70ed2ed605'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:38.808372 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b973a23056a94356a1180e70ed2ed605'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:38.833594 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1064/2113] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:16:38 2022] DELETE /identity/v3/users/b973a23056a94356a1180e70ed2ed605 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:16:38.835527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f4659-7bd6-450b-bacb-e32cc6e28397 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:38.836022 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f4659-7bd6-450b-bacb-e32cc6e28397 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:38.836121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f4659-7bd6-450b-bacb-e32cc6e28397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:38.855748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c25f4659-7bd6-450b-bacb-e32cc6e28397 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:38.856370 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c25f4659-7bd6-450b-bacb-e32cc6e28397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:38.898374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:38.917892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1050/2114] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:38.927553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:38.928964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:38.989057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c0bb1-c1a8-4541-9207-23f00f050d8e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:38.992645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db53a3-245c-4715-8ee6-0770e93acbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:38.993281 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db53a3-245c-4715-8ee6-0770e93acbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:38.993591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db53a3-245c-4715-8ee6-0770e93acbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:38.993864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db53a3-245c-4715-8ee6-0770e93acbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.003395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db53a3-245c-4715-8ee6-0770e93acbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:39.004804 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db53a3-245c-4715-8ee6-0770e93acbe6 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:39.014137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1065/2115] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:16:39.183775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f4659-7bd6-450b-bacb-e32cc6e28397 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:39.185438 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c25f4659-7bd6-450b-bacb-e32cc6e28397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:39.207328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f4659-7bd6-450b-bacb-e32cc6e28397 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:39.212219 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:39.213164 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.213581 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.213781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] PATH_INFO: `/v3/projects/d90b5dff6cf54c7c8f0f5e18f9ad7b19` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.214891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90b5dff6cf54c7c8f0f5e18f9ad7b19)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:39.216849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:39.271469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90b5dff6cf54c7c8f0f5e18f9ad7b19', 'request_id': 'req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:39.280471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90b5dff6cf54c7c8f0f5e18f9ad7b19', 'request_id': 'req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:39.286338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90b5dff6cf54c7c8f0f5e18f9ad7b19', 'request_id': 'req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:39.297937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] The token cache is being invalidate because project d90b5dff6cf54c7c8f0f5e18f9ad7b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:16:39.298340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:39.299011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3d88c49-ea7e-40dd-9fde-31d9b93f82ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:39.300551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1051/2116] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:16:39 2022] DELETE /identity/v3/projects/d90b5dff6cf54c7c8f0f5e18f9ad7b19 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:16:39.305867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28b44a-38ac-4ae5-8b9f-f0a59bcd343c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.306100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28b44a-38ac-4ae5-8b9f-f0a59bcd343c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.306382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28b44a-38ac-4ae5-8b9f-f0a59bcd343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.324537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1b28b44a-38ac-4ae5-8b9f-f0a59bcd343c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:39.325777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1b28b44a-38ac-4ae5-8b9f-f0a59bcd343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:39.353035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:39.394709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1066/2117] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:39.406774 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e59e1-6c20-4f1a-b5b6-7fea0e98c805 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.407062 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e59e1-6c20-4f1a-b5b6-7fea0e98c805 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.408431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e59e1-6c20-4f1a-b5b6-7fea0e98c805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.427577 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5c3e59e1-6c20-4f1a-b5b6-7fea0e98c805 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:39.428789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5c3e59e1-6c20-4f1a-b5b6-7fea0e98c805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:39.437449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1052/2118] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:39.441583 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28b44a-38ac-4ae5-8b9f-f0a59bcd343c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:39.451669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28b44a-38ac-4ae5-8b9f-f0a59bcd343c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:39.456308 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64350cac-df51-4c7a-863c-d1bd67ddffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:39.457092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64350cac-df51-4c7a-863c-d1bd67ddffc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.457382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64350cac-df51-4c7a-863c-d1bd67ddffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.457748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64350cac-df51-4c7a-863c-d1bd67ddffc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.458510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64350cac-df51-4c7a-863c-d1bd67ddffc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:16:39.458848 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64350cac-df51-4c7a-863c-d1bd67ddffc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:39.460636 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64350cac-df51-4c7a-863c-d1bd67ddffc7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:39.473933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1067/2119] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:16:39.479185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e59e1-6c20-4f1a-b5b6-7fea0e98c805 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:39.488983 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e59e1-6c20-4f1a-b5b6-7fea0e98c805 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:39.494072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c048f9-1042-4931-b9c8-c4aeb17613e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:39.494838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c048f9-1042-4931-b9c8-c4aeb17613e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.495035 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c048f9-1042-4931-b9c8-c4aeb17613e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.495303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c048f9-1042-4931-b9c8-c4aeb17613e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.496004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c048f9-1042-4931-b9c8-c4aeb17613e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:39.497985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c048f9-1042-4931-b9c8-c4aeb17613e5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:39.526092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1053/2120] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:16:39 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:16:39.530284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64350cac-df51-4c7a-863c-d1bd67ddffc7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:39.543176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64350cac-df51-4c7a-863c-d1bd67ddffc7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:39.607978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651126b9-dfd0-4979-b61c-139dddd16594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:39.608777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651126b9-dfd0-4979-b61c-139dddd16594 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.609134 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651126b9-dfd0-4979-b61c-139dddd16594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.609415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651126b9-dfd0-4979-b61c-139dddd16594 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.610184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651126b9-dfd0-4979-b61c-139dddd16594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:39.612229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651126b9-dfd0-4979-b61c-139dddd16594 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:39.637556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1068/2121] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:16:39 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:16:39.638759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c048f9-1042-4931-b9c8-c4aeb17613e5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:39.649967 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c048f9-1042-4931-b9c8-c4aeb17613e5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:39.655391 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d5f5-5ce4-46c4-a98a-2e3b2233b720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:39.656307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d5f5-5ce4-46c4-a98a-2e3b2233b720 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.656598 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d5f5-5ce4-46c4-a98a-2e3b2233b720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.656874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030d5f5-5ce4-46c4-a98a-2e3b2233b720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.657649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030d5f5-5ce4-46c4-a98a-2e3b2233b720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:39.659267 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030d5f5-5ce4-46c4-a98a-2e3b2233b720 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:39.676305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1054/2122] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:39.680138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651126b9-dfd0-4979-b61c-139dddd16594 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:39.690574 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651126b9-dfd0-4979-b61c-139dddd16594 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:39.698911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb5825-6a20-4b81-84f3-3a42a48755fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:39.699680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb5825-6a20-4b81-84f3-3a42a48755fa admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.699979 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb5825-6a20-4b81-84f3-3a42a48755fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.700269 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb5825-6a20-4b81-84f3-3a42a48755fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.701006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb5825-6a20-4b81-84f3-3a42a48755fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:39.702767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb5825-6a20-4b81-84f3-3a42a48755fa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:39.718087 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1069/2123] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:39.720074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d5f5-5ce4-46c4-a98a-2e3b2233b720 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:39.730929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030d5f5-5ce4-46c4-a98a-2e3b2233b720 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:39.737112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56d93-1175-4372-ae43-c82f192afee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:39.738866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56d93-1175-4372-ae43-c82f192afee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.739273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56d93-1175-4372-ae43-c82f192afee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.739765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56d93-1175-4372-ae43-c82f192afee3 admin admin] PATH_INFO: `/v3/projects/24164927ad41418491f01196b71ce325/users/a46beb5fe7d145d5aa0a821c471f2dc9/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.759182 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc56d93-1175-4372-ae43-c82f192afee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24164927ad41418491f01196b71ce325, user_id=a46beb5fe7d145d5aa0a821c471f2dc9, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:39.763181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc56d93-1175-4372-ae43-c82f192afee3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:39.784515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1055/2124] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:16:39 2022] PUT /identity/v3/projects/24164927ad41418491f01196b71ce325/users/a46beb5fe7d145d5aa0a821c471f2dc9/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:16:39.790620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821b2b1-3d55-4d8f-927b-d30d43bb0058 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:39.790989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821b2b1-3d55-4d8f-927b-d30d43bb0058 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:39.791310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821b2b1-3d55-4d8f-927b-d30d43bb0058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:39.810018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6821b2b1-3d55-4d8f-927b-d30d43bb0058 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:39.811377 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6821b2b1-3d55-4d8f-927b-d30d43bb0058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:39.892748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1070/2125] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:39.911998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56d93-1175-4372-ae43-c82f192afee3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:39.918521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8bc56d93-1175-4372-ae43-c82f192afee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:40.003470 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56d93-1175-4372-ae43-c82f192afee3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:40.007984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a782cd1-d188-4867-9560-371c8b40eae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:40.008633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a782cd1-d188-4867-9560-371c8b40eae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:40.008920 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a782cd1-d188-4867-9560-371c8b40eae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:40.009199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a782cd1-d188-4867-9560-371c8b40eae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:40.019945 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a782cd1-d188-4867-9560-371c8b40eae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:40.021420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a782cd1-d188-4867-9560-371c8b40eae5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:40.032832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1056/2126] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:16:44.693040 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53db41-0894-45ab-8042-74cdc30e135a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:44.694009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53db41-0894-45ab-8042-74cdc30e135a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:44.694442 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53db41-0894-45ab-8042-74cdc30e135a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:44.728981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9b53db41-0894-45ab-8042-74cdc30e135a None None] MFA Rules not processed for user `a46beb5fe7d145d5aa0a821c471f2dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:44.730386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9b53db41-0894-45ab-8042-74cdc30e135a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:44.769017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:44.816645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1071/2127] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:44.821208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a782cd1-d188-4867-9560-371c8b40eae5 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:44.831524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a782cd1-d188-4867-9560-371c8b40eae5 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:44.838805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d804a22-8dcc-4a58-afdd-927d12bf4eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:44.839505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d804a22-8dcc-4a58-afdd-927d12bf4eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:44.839891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d804a22-8dcc-4a58-afdd-927d12bf4eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:44.840128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d804a22-8dcc-4a58-afdd-927d12bf4eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:44.840840 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d804a22-8dcc-4a58-afdd-927d12bf4eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:44.842860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d804a22-8dcc-4a58-afdd-927d12bf4eb5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:44.852978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:44.946587 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1057/2128] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:16:44 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:16:44.950721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53db41-0894-45ab-8042-74cdc30e135a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:44.966719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53db41-0894-45ab-8042-74cdc30e135a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:45.048707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27341390-2c58-44d9-b311-e5c6a7b2850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:45.049422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27341390-2c58-44d9-b311-e5c6a7b2850b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:45.049768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27341390-2c58-44d9-b311-e5c6a7b2850b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:45.050013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27341390-2c58-44d9-b311-e5c6a7b2850b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:45.051051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27341390-2c58-44d9-b311-e5c6a7b2850b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:45.053184 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27341390-2c58-44d9-b311-e5c6a7b2850b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:45.099480 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1072/2129] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:16:44 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:16:45.103186 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d804a22-8dcc-4a58-afdd-927d12bf4eb5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:45.163620 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d804a22-8dcc-4a58-afdd-927d12bf4eb5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:45.171833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6ae2-0dd4-4a6b-83a5-fd25d1227200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:45.172752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6ae2-0dd4-4a6b-83a5-fd25d1227200 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:45.173128 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6ae2-0dd4-4a6b-83a5-fd25d1227200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:45.173490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d6ae2-0dd4-4a6b-83a5-fd25d1227200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:45.174382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d6ae2-0dd4-4a6b-83a5-fd25d1227200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:45.179841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d6ae2-0dd4-4a6b-83a5-fd25d1227200 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:45.200848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1058/2130] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:45.201784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27341390-2c58-44d9-b311-e5c6a7b2850b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:45.220045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27341390-2c58-44d9-b311-e5c6a7b2850b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:45.225910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb19a3e-0c74-4e6d-ab08-0d9d14a378ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:45.226822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb19a3e-0c74-4e6d-ab08-0d9d14a378ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:45.227109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb19a3e-0c74-4e6d-ab08-0d9d14a378ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:45.227393 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb19a3e-0c74-4e6d-ab08-0d9d14a378ce admin admin] PATH_INFO: `/v3/projects/6c596515bd33403cabcc2b1cc9da1ae8/users/9067845498654522b4a1b76575452bf8/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:45.270929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb19a3e-0c74-4e6d-ab08-0d9d14a378ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c596515bd33403cabcc2b1cc9da1ae8, user_id=9067845498654522b4a1b76575452bf8, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:45.275825 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb19a3e-0c74-4e6d-ab08-0d9d14a378ce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:45.301996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6ae2-0dd4-4a6b-83a5-fd25d1227200 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:45.303093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1073/2131] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:16:45 2022] PUT /identity/v3/projects/6c596515bd33403cabcc2b1cc9da1ae8/users/9067845498654522b4a1b76575452bf8/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:16:45.317227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d6ae2-0dd4-4a6b-83a5-fd25d1227200 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:45.415528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164ac70-a6f2-4097-b661-022eec1613d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:45.416369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164ac70-a6f2-4097-b661-022eec1613d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:45.416805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164ac70-a6f2-4097-b661-022eec1613d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:45.417192 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164ac70-a6f2-4097-b661-022eec1613d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:45.428271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164ac70-a6f2-4097-b661-022eec1613d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:45.428271 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164ac70-a6f2-4097-b661-022eec1613d4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:45.456899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb19a3e-0c74-4e6d-ab08-0d9d14a378ce admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:45.508905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1059/2132] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:45.512498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb19a3e-0c74-4e6d-ab08-0d9d14a378ce admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:45.531957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64604be3-e7ea-4db1-bf36-5d76a9ec521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:45.532370 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64604be3-e7ea-4db1-bf36-5d76a9ec521f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:45.532658 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64604be3-e7ea-4db1-bf36-5d76a9ec521f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:45.532941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64604be3-e7ea-4db1-bf36-5d76a9ec521f admin admin] PATH_INFO: `/v3/projects/6c596515bd33403cabcc2b1cc9da1ae8/users/9067845498654522b4a1b76575452bf8/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:45.544235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64604be3-e7ea-4db1-bf36-5d76a9ec521f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c596515bd33403cabcc2b1cc9da1ae8, user_id=9067845498654522b4a1b76575452bf8, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:45.548320 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64604be3-e7ea-4db1-bf36-5d76a9ec521f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:45.571678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1074/2133] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:16:45 2022] PUT /identity/v3/projects/6c596515bd33403cabcc2b1cc9da1ae8/users/9067845498654522b4a1b76575452bf8/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:16:50.620514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708d18e-e5be-4799-8bd5-5d49b39b20e8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:50.621050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708d18e-e5be-4799-8bd5-5d49b39b20e8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:50.621813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708d18e-e5be-4799-8bd5-5d49b39b20e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:50.652828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4708d18e-e5be-4799-8bd5-5d49b39b20e8 None None] MFA Rules not processed for user `9067845498654522b4a1b76575452bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:50.654115 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4708d18e-e5be-4799-8bd5-5d49b39b20e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:50.726311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1060/2134] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:50.742096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64604be3-e7ea-4db1-bf36-5d76a9ec521f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:50.746703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-64604be3-e7ea-4db1-bf36-5d76a9ec521f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:50.837655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:50.856755 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64604be3-e7ea-4db1-bf36-5d76a9ec521f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:50.863925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f610ae-ed7d-4162-aea5-f6f04b4b6edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:50.864747 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f610ae-ed7d-4162-aea5-f6f04b4b6edb service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:50.865026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f610ae-ed7d-4162-aea5-f6f04b4b6edb service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:50.865300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f610ae-ed7d-4162-aea5-f6f04b4b6edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:50.939105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f610ae-ed7d-4162-aea5-f6f04b4b6edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:50.940858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f610ae-ed7d-4162-aea5-f6f04b4b6edb service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:50.953604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1075/2135] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:16:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:16:52.362780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3de08-5fe2-41fa-aa11-be56aef2fa34 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:52.364092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3de08-5fe2-41fa-aa11-be56aef2fa34 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:52.364605 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3de08-5fe2-41fa-aa11-be56aef2fa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:52.386602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c7d3de08-5fe2-41fa-aa11-be56aef2fa34 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:52.388218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7d3de08-5fe2-41fa-aa11-be56aef2fa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:52.509350 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1061/2136] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:52.530007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f610ae-ed7d-4162-aea5-f6f04b4b6edb service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:52.531758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c0f610ae-ed7d-4162-aea5-f6f04b4b6edb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:52.609976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3de08-5fe2-41fa-aa11-be56aef2fa34 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:52.612359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7d3de08-5fe2-41fa-aa11-be56aef2fa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:52.619299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:52.713851 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3de08-5fe2-41fa-aa11-be56aef2fa34 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:52.719284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:52.720641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:52.721672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f610ae-ed7d-4162-aea5-f6f04b4b6edb service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:52.723877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:52.724369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] PATH_INFO: `/v3/users/43c4a47c94e34362ba755b089b019440` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:52.726925 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c4a47c94e34362ba755b089b019440)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:52.730735 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0746238-92e0-41cd-bbcb-d473cd5c90a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:52.731607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0746238-92e0-41cd-bbcb-d473cd5c90a8 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:52.732047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0746238-92e0-41cd-bbcb-d473cd5c90a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:52.732486 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0746238-92e0-41cd-bbcb-d473cd5c90a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:52.734489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:52.756472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0746238-92e0-41cd-bbcb-d473cd5c90a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:52.758610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0746238-92e0-41cd-bbcb-d473cd5c90a8 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:52.793988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1076/2137] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:16:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:16:52.864601 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c4a47c94e34362ba755b089b019440'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:52.929693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c4a47c94e34362ba755b089b019440'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:52.946166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c4a47c94e34362ba755b089b019440'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:52.968800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c4a47c94e34362ba755b089b019440'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:52.973214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c4a47c94e34362ba755b089b019440'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:53.007658 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1062/2138] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:16:52 2022] DELETE /identity/v3/users/43c4a47c94e34362ba755b089b019440 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:16:53.013648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1f4e6-d342-4a6d-abc7-1dec294bc633 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:53.014115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1f4e6-d342-4a6d-abc7-1dec294bc633 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:53.014531 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1f4e6-d342-4a6d-abc7-1dec294bc633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:53.045220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-61a1f4e6-d342-4a6d-abc7-1dec294bc633 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:53.046459 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61a1f4e6-d342-4a6d-abc7-1dec294bc633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:53.121964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1077/2139] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:53.131670 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:53.133422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:53.214447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d220c4-944c-4799-8a87-ad9add9e2f98 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:53.225117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43f72d-db8b-4323-9fc9-eb9bd0fd66ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:53.225705 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43f72d-db8b-4323-9fc9-eb9bd0fd66ca service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:53.225997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43f72d-db8b-4323-9fc9-eb9bd0fd66ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:53.226279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43f72d-db8b-4323-9fc9-eb9bd0fd66ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:53.238187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43f72d-db8b-4323-9fc9-eb9bd0fd66ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:53.240102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43f72d-db8b-4323-9fc9-eb9bd0fd66ca service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:53.254017 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1063/2140] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:16:53.625539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1f4e6-d342-4a6d-abc7-1dec294bc633 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:53.628884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61a1f4e6-d342-4a6d-abc7-1dec294bc633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:53.661703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1f4e6-d342-4a6d-abc7-1dec294bc633 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:53.672082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:53.673559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:53.674395 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:53.674886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] PATH_INFO: `/v3/projects/310a751b2a744c468555e802f633a523` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:53.676753 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310a751b2a744c468555e802f633a523)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:53.680097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:53.716111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:53.786872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310a751b2a744c468555e802f633a523', 'request_id': 'req-3aaec967-d6d8-4d26-835e-f425813c8868'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:53.795133 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310a751b2a744c468555e802f633a523', 'request_id': 'req-3aaec967-d6d8-4d26-835e-f425813c8868'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:53.801867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310a751b2a744c468555e802f633a523', 'request_id': 'req-3aaec967-d6d8-4d26-835e-f425813c8868'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:53.827073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] The token cache is being invalidate because project 310a751b2a744c468555e802f633a523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:16:53.830974 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:53.832032 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:53.833905 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1078/2141] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:16:53 2022] DELETE /identity/v3/projects/310a751b2a744c468555e802f633a523 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:16:53.838155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43f72d-db8b-4323-9fc9-eb9bd0fd66ca service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:53.860432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43f72d-db8b-4323-9fc9-eb9bd0fd66ca service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:53.998522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:54.082052 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:54.083368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:54.083873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:54.084373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] PATH_INFO: `/v3/users/b4254dbfe0ca4735ad988aef2c6bcdf4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:54.086037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4254dbfe0ca4735ad988aef2c6bcdf4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:54.089748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:54.192884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4254dbfe0ca4735ad988aef2c6bcdf4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:54.223792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4254dbfe0ca4735ad988aef2c6bcdf4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:54.240640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4254dbfe0ca4735ad988aef2c6bcdf4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:54.254496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4254dbfe0ca4735ad988aef2c6bcdf4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:54.257654 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7381d16-21db-4a66-8b76-87e9162fadb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4254dbfe0ca4735ad988aef2c6bcdf4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:54.276295 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1064/2142] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:16:53 2022] DELETE /identity/v3/users/b4254dbfe0ca4735ad988aef2c6bcdf4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:16:54.913286 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:54.915669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:54.983754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaec967-d6d8-4d26-835e-f425813c8868 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:55.063125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:55.064564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:55.065089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:55.065558 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] PATH_INFO: `/v3/projects/30cb36fad4944cbf9bb72ade29d7f03e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:55.067073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cb36fad4944cbf9bb72ade29d7f03e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:55.069997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:55.167853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cb36fad4944cbf9bb72ade29d7f03e', 'request_id': 'req-1c02f0f5-6322-4cba-8822-8d772e9f98de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:55.174475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cb36fad4944cbf9bb72ade29d7f03e', 'request_id': 'req-1c02f0f5-6322-4cba-8822-8d772e9f98de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:55.180625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cb36fad4944cbf9bb72ade29d7f03e', 'request_id': 'req-1c02f0f5-6322-4cba-8822-8d772e9f98de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:55.204444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] The token cache is being invalidate because project 30cb36fad4944cbf9bb72ade29d7f03e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:16:55.204444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:55.204444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1c02f0f5-6322-4cba-8822-8d772e9f98de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:16:55.204841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1079/2143] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:16:54 2022] DELETE /identity/v3/projects/30cb36fad4944cbf9bb72ade29d7f03e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:16:55.210656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac671c-2d34-41b1-a029-52e4ebb1a50b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:55.211220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac671c-2d34-41b1-a029-52e4ebb1a50b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:55.211220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac671c-2d34-41b1-a029-52e4ebb1a50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:55.234472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-21ac671c-2d34-41b1-a029-52e4ebb1a50b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:55.235691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-21ac671c-2d34-41b1-a029-52e4ebb1a50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:55.342057 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084d9c-a2c7-4174-b773-a71197e6d1b7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:55.342509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084d9c-a2c7-4174-b773-a71197e6d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:55.343101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084d9c-a2c7-4174-b773-a71197e6d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:55.357093 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1065/2144] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:55.373646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-11084d9c-a2c7-4174-b773-a71197e6d1b7 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:55.373646 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11084d9c-a2c7-4174-b773-a71197e6d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:55.384817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1080/2145] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:55.389322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac671c-2d34-41b1-a029-52e4ebb1a50b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:55.404861 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac671c-2d34-41b1-a029-52e4ebb1a50b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:55.418210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb06da-455e-4aa3-b27a-23c9cc57665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:55.418894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb06da-455e-4aa3-b27a-23c9cc57665f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:55.419210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb06da-455e-4aa3-b27a-23c9cc57665f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:55.419443 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb06da-455e-4aa3-b27a-23c9cc57665f admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:55.420211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb06da-455e-4aa3-b27a-23c9cc57665f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:16:55.420518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb06da-455e-4aa3-b27a-23c9cc57665f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:55.422378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb06da-455e-4aa3-b27a-23c9cc57665f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:55.446403 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1066/2146] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:16:55.452593 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11084d9c-a2c7-4174-b773-a71197e6d1b7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:55.471946 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11084d9c-a2c7-4174-b773-a71197e6d1b7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:55.479911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ddfeb-e3b6-4038-820a-d3985b405d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:55.481233 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ddfeb-e3b6-4038-820a-d3985b405d51 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:55.481627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ddfeb-e3b6-4038-820a-d3985b405d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:55.481983 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ddfeb-e3b6-4038-820a-d3985b405d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:55.482928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ddfeb-e3b6-4038-820a-d3985b405d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:55.487058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ddfeb-e3b6-4038-820a-d3985b405d51 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:55.543096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:55.568997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1081/2147] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:16:55 2022] POST /identity/v3/projects => generated 359 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:16:55.573855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb06da-455e-4aa3-b27a-23c9cc57665f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:55.595448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb06da-455e-4aa3-b27a-23c9cc57665f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:55.678779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:55.737743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2006bc8-a141-4bcf-be49-33b4ed5187b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:55.738342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2006bc8-a141-4bcf-be49-33b4ed5187b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:55.738631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2006bc8-a141-4bcf-be49-33b4ed5187b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:55.738903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2006bc8-a141-4bcf-be49-33b4ed5187b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:55.740338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2006bc8-a141-4bcf-be49-33b4ed5187b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:55.742554 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2006bc8-a141-4bcf-be49-33b4ed5187b6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:55.785752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1067/2148] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:16:55 2022] POST /identity/v3/users => generated 280 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:16:55.794832 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ddfeb-e3b6-4038-820a-d3985b405d51 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:55.811032 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ddfeb-e3b6-4038-820a-d3985b405d51 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:55.824973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc30d-8724-4ce9-9904-4b22a989f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:55.828876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc30d-8724-4ce9-9904-4b22a989f889 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:55.829354 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc30d-8724-4ce9-9904-4b22a989f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:55.829987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc30d-8724-4ce9-9904-4b22a989f889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:55.833353 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedc30d-8724-4ce9-9904-4b22a989f889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:55.835604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedc30d-8724-4ce9-9904-4b22a989f889 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:55.864113 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1082/2149] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:55.865354 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2006bc8-a141-4bcf-be49-33b4ed5187b6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:55.887333 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2006bc8-a141-4bcf-be49-33b4ed5187b6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:55.896869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac19f8-44c1-40bf-be9d-2ef2395e4588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:55.898303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac19f8-44c1-40bf-be9d-2ef2395e4588 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:55.898756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac19f8-44c1-40bf-be9d-2ef2395e4588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:55.899689 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac19f8-44c1-40bf-be9d-2ef2395e4588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:55.901140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac19f8-44c1-40bf-be9d-2ef2395e4588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:55.904198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac19f8-44c1-40bf-be9d-2ef2395e4588 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:55.946745 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1068/2150] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:55.947011 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc30d-8724-4ce9-9904-4b22a989f889 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:55.959385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc30d-8724-4ce9-9904-4b22a989f889 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:55.967304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5a0c3-bbe7-4ded-b030-23a87e33c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:55.969154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a0c3-bbe7-4ded-b030-23a87e33c191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:55.969669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a0c3-bbe7-4ded-b030-23a87e33c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:55.973314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a0c3-bbe7-4ded-b030-23a87e33c191 admin admin] PATH_INFO: `/v3/projects/104826f60a0b4c07a0e91d7308345bb4/users/f80c382bb86a46fd8c16827a008e1904/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:56.006084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5a0c3-bbe7-4ded-b030-23a87e33c191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104826f60a0b4c07a0e91d7308345bb4, user_id=f80c382bb86a46fd8c16827a008e1904, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:56.011744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5a0c3-bbe7-4ded-b030-23a87e33c191 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:56.049430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1083/2151] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:16:55 2022] PUT /identity/v3/projects/104826f60a0b4c07a0e91d7308345bb4/users/f80c382bb86a46fd8c16827a008e1904/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:16:56.060418 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6792d-c8f5-42d4-8a5e-16d3aa98c06a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:56.060694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6792d-c8f5-42d4-8a5e-16d3aa98c06a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:56.061027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6792d-c8f5-42d4-8a5e-16d3aa98c06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:56.112862 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-74f6792d-c8f5-42d4-8a5e-16d3aa98c06a None None] MFA Rules not processed for user `f80c382bb86a46fd8c16827a008e1904`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:56.114274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-74f6792d-c8f5-42d4-8a5e-16d3aa98c06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:56.287684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1069/2152] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:56 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:56.292291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5a0c3-bbe7-4ded-b030-23a87e33c191 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:56.420292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5a0c3-bbe7-4ded-b030-23a87e33c191 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:56.446063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a717a-8ed4-46b9-a3a8-b1b6fd7cd699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:56.453958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a717a-8ed4-46b9-a3a8-b1b6fd7cd699 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:56.454926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a717a-8ed4-46b9-a3a8-b1b6fd7cd699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:56.455360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a717a-8ed4-46b9-a3a8-b1b6fd7cd699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:56.456364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a717a-8ed4-46b9-a3a8-b1b6fd7cd699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:56.472272 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a717a-8ed4-46b9-a3a8-b1b6fd7cd699 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:56.527977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1084/2153] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:16:56 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:16:56.533632 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6792d-c8f5-42d4-8a5e-16d3aa98c06a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:56.563846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6792d-c8f5-42d4-8a5e-16d3aa98c06a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:56.719525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35957c9f-f827-4eb3-a36b-1a62cf888ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:56.720574 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35957c9f-f827-4eb3-a36b-1a62cf888ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:56.721105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35957c9f-f827-4eb3-a36b-1a62cf888ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:56.721644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35957c9f-f827-4eb3-a36b-1a62cf888ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:56.722516 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35957c9f-f827-4eb3-a36b-1a62cf888ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:56.724961 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35957c9f-f827-4eb3-a36b-1a62cf888ab4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:56.791673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1070/2154] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:16:56 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:16:56.795253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a717a-8ed4-46b9-a3a8-b1b6fd7cd699 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:56.808954 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a717a-8ed4-46b9-a3a8-b1b6fd7cd699 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:56.821902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395e38-336f-469b-97f5-b809e4825172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:56.822626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395e38-336f-469b-97f5-b809e4825172 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:56.822929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395e38-336f-469b-97f5-b809e4825172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:56.823212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395e38-336f-469b-97f5-b809e4825172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:56.826557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82395e38-336f-469b-97f5-b809e4825172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:56.826557 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82395e38-336f-469b-97f5-b809e4825172 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:56.861817 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35957c9f-f827-4eb3-a36b-1a62cf888ab4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:56.869457 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1085/2155] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:56.878998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35957c9f-f827-4eb3-a36b-1a62cf888ab4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:56.885593 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9a505-e8ea-457b-aaa4-5a14d0153382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:56.886492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9a505-e8ea-457b-aaa4-5a14d0153382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:56.886771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9a505-e8ea-457b-aaa4-5a14d0153382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:56.887047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9a505-e8ea-457b-aaa4-5a14d0153382 admin admin] PATH_INFO: `/v3/projects/74480e0adc654dc4a4f6fa555de7be6e/users/382b1af78cec41aeb776ed30c77aeee8/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:56.923580 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9a505-e8ea-457b-aaa4-5a14d0153382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74480e0adc654dc4a4f6fa555de7be6e, user_id=382b1af78cec41aeb776ed30c77aeee8, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:56.928006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9a505-e8ea-457b-aaa4-5a14d0153382 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:56.956958 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1071/2156] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:16:56 2022] PUT /identity/v3/projects/74480e0adc654dc4a4f6fa555de7be6e/users/382b1af78cec41aeb776ed30c77aeee8/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:16:56.958283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395e38-336f-469b-97f5-b809e4825172 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:56.976455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395e38-336f-469b-97f5-b809e4825172 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:57.090541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcfc7b-a4f6-4bfa-bda7-278a8cac1ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:57.091225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcfc7b-a4f6-4bfa-bda7-278a8cac1ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:57.091505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcfc7b-a4f6-4bfa-bda7-278a8cac1ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:57.091781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcfc7b-a4f6-4bfa-bda7-278a8cac1ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:57.092510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcfc7b-a4f6-4bfa-bda7-278a8cac1ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:57.094610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcfc7b-a4f6-4bfa-bda7-278a8cac1ea7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:57.119121 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1086/2157] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:16:57.121155 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9a505-e8ea-457b-aaa4-5a14d0153382 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:57.129051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:57.138899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9a505-e8ea-457b-aaa4-5a14d0153382 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:57.152384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53131b-d0cb-4222-a139-00df16c8a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:57.153392 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53131b-d0cb-4222-a139-00df16c8a09d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:57.153825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53131b-d0cb-4222-a139-00df16c8a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:57.154256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53131b-d0cb-4222-a139-00df16c8a09d admin admin] PATH_INFO: `/v3/projects/74480e0adc654dc4a4f6fa555de7be6e/users/382b1af78cec41aeb776ed30c77aeee8/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:57.157811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53131b-d0cb-4222-a139-00df16c8a09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74480e0adc654dc4a4f6fa555de7be6e, user_id=382b1af78cec41aeb776ed30c77aeee8, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:57.162046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53131b-d0cb-4222-a139-00df16c8a09d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:57.190452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713293e-7a5b-457a-91db-3699f55f3082 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:57.190751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713293e-7a5b-457a-91db-3699f55f3082 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:57.191039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713293e-7a5b-457a-91db-3699f55f3082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:57.192382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1072/2158] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:16:57 2022] PUT /identity/v3/projects/74480e0adc654dc4a4f6fa555de7be6e/users/382b1af78cec41aeb776ed30c77aeee8/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:16:57.226211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5713293e-7a5b-457a-91db-3699f55f3082 None None] MFA Rules not processed for user `382b1af78cec41aeb776ed30c77aeee8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:16:57.227469 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5713293e-7a5b-457a-91db-3699f55f3082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:57.253626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:16:57.332325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1087/2159] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:16:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:16:57.344710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53131b-d0cb-4222-a139-00df16c8a09d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:57.346527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0d53131b-d0cb-4222-a139-00df16c8a09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:16:57.466617 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53131b-d0cb-4222-a139-00df16c8a09d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:57.473497 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd5774-ae6f-4b81-9fc4-de5f48c653bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:57.474288 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd5774-ae6f-4b81-9fc4-de5f48c653bf service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:57.474691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd5774-ae6f-4b81-9fc4-de5f48c653bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:57.474994 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd5774-ae6f-4b81-9fc4-de5f48c653bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:57.486132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd5774-ae6f-4b81-9fc4-de5f48c653bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:57.487595 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd5774-ae6f-4b81-9fc4-de5f48c653bf service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:57.499987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1073/2160] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:16:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:16:57.617383 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713293e-7a5b-457a-91db-3699f55f3082 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:16:57.636181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713293e-7a5b-457a-91db-3699f55f3082 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:16:57.640952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927619e-e778-4cb6-99d4-0297a0fd56a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:16:57.641780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927619e-e778-4cb6-99d4-0297a0fd56a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:16:57.642082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927619e-e778-4cb6-99d4-0297a0fd56a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:16:57.642620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927619e-e778-4cb6-99d4-0297a0fd56a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:16:57.714396 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927619e-e778-4cb6-99d4-0297a0fd56a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:16:57.715863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927619e-e778-4cb6-99d4-0297a0fd56a7 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:16:57.736314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1088/2161] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:16:57 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:17:00.654316 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd5774-ae6f-4b81-9fc4-de5f48c653bf service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:00.739512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd5774-ae6f-4b81-9fc4-de5f48c653bf service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:00.747696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:00.749174 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:00.749599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:00.749992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] PATH_INFO: `/v3/users/f80c382bb86a46fd8c16827a008e1904` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:00.751358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80c382bb86a46fd8c16827a008e1904)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:00.753387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:00.816816 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80c382bb86a46fd8c16827a008e1904'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:00.839320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80c382bb86a46fd8c16827a008e1904'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:00.848684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80c382bb86a46fd8c16827a008e1904'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:00.854652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:00.861550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80c382bb86a46fd8c16827a008e1904'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:00.864066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80c382bb86a46fd8c16827a008e1904'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:00.874245 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1074/2162] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:17:00 2022] DELETE /identity/v3/users/f80c382bb86a46fd8c16827a008e1904 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:00.878380 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566a5f-9a44-431f-9e06-6898fc5df06c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:00.879111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566a5f-9a44-431f-9e06-6898fc5df06c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:00.879111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566a5f-9a44-431f-9e06-6898fc5df06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:00.903952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-25566a5f-9a44-431f-9e06-6898fc5df06c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:00.906254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-25566a5f-9a44-431f-9e06-6898fc5df06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:01.036917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1089/2163] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:17:01.047251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:01.048753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:01.178793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610727d-ad1c-4e3e-91cc-714ec19a2f81 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:01.187243 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a07f1-24ba-4bd7-a5d4-7e3815df77a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:01.187852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a07f1-24ba-4bd7-a5d4-7e3815df77a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:01.188144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a07f1-24ba-4bd7-a5d4-7e3815df77a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:01.188421 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a07f1-24ba-4bd7-a5d4-7e3815df77a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:01.219849 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a07f1-24ba-4bd7-a5d4-7e3815df77a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:01.221322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a07f1-24ba-4bd7-a5d4-7e3815df77a3 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:01.268792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1075/2164] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:17:01.720220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566a5f-9a44-431f-9e06-6898fc5df06c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:01.722318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-25566a5f-9a44-431f-9e06-6898fc5df06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:01.757893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566a5f-9a44-431f-9e06-6898fc5df06c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:01.768218 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:01.769130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:01.769422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:01.769733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] PATH_INFO: `/v3/projects/104826f60a0b4c07a0e91d7308345bb4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:01.771240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] RBAC: Authorizing `identity:delete_project(project_id=104826f60a0b4c07a0e91d7308345bb4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:01.776923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:01.968711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104826f60a0b4c07a0e91d7308345bb4', 'request_id': 'req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.002803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:02.049620 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104826f60a0b4c07a0e91d7308345bb4', 'request_id': 'req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.091038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104826f60a0b4c07a0e91d7308345bb4', 'request_id': 'req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.121898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] The token cache is being invalidate because project 104826f60a0b4c07a0e91d7308345bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:17:02.122200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.124132 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.132838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a07f1-24ba-4bd7-a5d4-7e3815df77a3 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:02.133634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1090/2165] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:17:01 2022] DELETE /identity/v3/projects/104826f60a0b4c07a0e91d7308345bb4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:02.147514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a07f1-24ba-4bd7-a5d4-7e3815df77a3 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:02.251824 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:02.252917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:02.253450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:02.254005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] PATH_INFO: `/v3/users/382b1af78cec41aeb776ed30c77aeee8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:02.255420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=382b1af78cec41aeb776ed30c77aeee8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:02.257736 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:02.346805 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382b1af78cec41aeb776ed30c77aeee8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.373146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382b1af78cec41aeb776ed30c77aeee8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.386348 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382b1af78cec41aeb776ed30c77aeee8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.396675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382b1af78cec41aeb776ed30c77aeee8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.397655 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8afaa3c8-8919-477a-83dc-6b66adcec667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382b1af78cec41aeb776ed30c77aeee8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:02.414523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1076/2166] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:17:02 2022] DELETE /identity/v3/users/382b1af78cec41aeb776ed30c77aeee8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:02.919241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:02.920779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:02.947634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66a1a1-de71-4ca9-a7ec-8f639dfd635b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:03.083834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:03.086875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.087319 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.087934 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] PATH_INFO: `/v3/projects/74480e0adc654dc4a4f6fa555de7be6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.090203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=74480e0adc654dc4a4f6fa555de7be6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:03.093461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:03.192707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74480e0adc654dc4a4f6fa555de7be6e', 'request_id': 'req-f2dbd058-4320-424c-9e28-cf64a3acc87e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:03.205619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74480e0adc654dc4a4f6fa555de7be6e', 'request_id': 'req-f2dbd058-4320-424c-9e28-cf64a3acc87e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:03.214472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74480e0adc654dc4a4f6fa555de7be6e', 'request_id': 'req-f2dbd058-4320-424c-9e28-cf64a3acc87e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:03.236676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] The token cache is being invalidate because project 74480e0adc654dc4a4f6fa555de7be6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:17:03.237099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:03.237784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2dbd058-4320-424c-9e28-cf64a3acc87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:03.239507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1091/2167] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:17:02 2022] DELETE /identity/v3/projects/74480e0adc654dc4a4f6fa555de7be6e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:03.247184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161ec9-2534-44d7-8fd1-b255408ac67d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.248590 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161ec9-2534-44d7-8fd1-b255408ac67d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.249183 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161ec9-2534-44d7-8fd1-b255408ac67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.284948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1d161ec9-2534-44d7-8fd1-b255408ac67d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:03.287431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1d161ec9-2534-44d7-8fd1-b255408ac67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:03.309727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:03.386463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1077/2168] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:03.388590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b010d-79f8-4fa6-917c-42ac6d641bc9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.388989 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b010d-79f8-4fa6-917c-42ac6d641bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.389381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b010d-79f8-4fa6-917c-42ac6d641bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.414391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-151b010d-79f8-4fa6-917c-42ac6d641bc9 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:03.416553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-151b010d-79f8-4fa6-917c-42ac6d641bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:03.433233 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1092/2169] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:03.434201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d161ec9-2534-44d7-8fd1-b255408ac67d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:03.444987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d161ec9-2534-44d7-8fd1-b255408ac67d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:03.451582 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9cc4f-85fe-4160-9fc6-1890a841c19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:03.452336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9cc4f-85fe-4160-9fc6-1890a841c19e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.452686 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9cc4f-85fe-4160-9fc6-1890a841c19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.453038 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9cc4f-85fe-4160-9fc6-1890a841c19e admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.453898 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9cc4f-85fe-4160-9fc6-1890a841c19e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:17:03.454299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9cc4f-85fe-4160-9fc6-1890a841c19e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:03.456005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9cc4f-85fe-4160-9fc6-1890a841c19e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:03.473342 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1078/2170] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:17:03.475299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b010d-79f8-4fa6-917c-42ac6d641bc9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:03.488400 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b010d-79f8-4fa6-917c-42ac6d641bc9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:03.500631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d4705-f112-4298-8905-175b89fbf636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:03.503475 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d4705-f112-4298-8905-175b89fbf636 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.503843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d4705-f112-4298-8905-175b89fbf636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.504364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d4705-f112-4298-8905-175b89fbf636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.505266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d4705-f112-4298-8905-175b89fbf636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:03.510246 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d4705-f112-4298-8905-175b89fbf636 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:03.552401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1093/2171] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:17:03 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:17:03.553825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9cc4f-85fe-4160-9fc6-1890a841c19e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:03.566036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9cc4f-85fe-4160-9fc6-1890a841c19e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:03.642624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d9b0-618b-4293-9cb5-081848a47a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:03.643451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d9b0-618b-4293-9cb5-081848a47a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.643828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d9b0-618b-4293-9cb5-081848a47a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.644280 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d9b0-618b-4293-9cb5-081848a47a76 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.645076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14d9b0-618b-4293-9cb5-081848a47a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:03.647095 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14d9b0-618b-4293-9cb5-081848a47a76 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:03.677524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1079/2172] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:17:03 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:17:03.679168 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d4705-f112-4298-8905-175b89fbf636 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:03.692262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d4705-f112-4298-8905-175b89fbf636 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:03.718345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306fe19-bd93-4356-a8b2-b5d45eaa84c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:03.719284 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306fe19-bd93-4356-a8b2-b5d45eaa84c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.722660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306fe19-bd93-4356-a8b2-b5d45eaa84c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.723029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306fe19-bd93-4356-a8b2-b5d45eaa84c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.723866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306fe19-bd93-4356-a8b2-b5d45eaa84c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:03.725546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306fe19-bd93-4356-a8b2-b5d45eaa84c1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:03.748709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1094/2173] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:17:03.752514 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d9b0-618b-4293-9cb5-081848a47a76 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:03.764266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d9b0-618b-4293-9cb5-081848a47a76 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:03.769192 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a16186-a3f8-414f-bb01-fbf733b893dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:03.769902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a16186-a3f8-414f-bb01-fbf733b893dc admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.770205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a16186-a3f8-414f-bb01-fbf733b893dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.770485 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a16186-a3f8-414f-bb01-fbf733b893dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.771227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a16186-a3f8-414f-bb01-fbf733b893dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:03.772887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a16186-a3f8-414f-bb01-fbf733b893dc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:03.785747 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1080/2174] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:17:03.790037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306fe19-bd93-4356-a8b2-b5d45eaa84c1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:03.809632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306fe19-bd93-4356-a8b2-b5d45eaa84c1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:03.815565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82839d8-cdf3-4224-908a-9f78dac4490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:03.816547 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82839d8-cdf3-4224-908a-9f78dac4490d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.816962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82839d8-cdf3-4224-908a-9f78dac4490d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.817330 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82839d8-cdf3-4224-908a-9f78dac4490d admin admin] PATH_INFO: `/v3/projects/2e40ae78b41b409f984925d0c95b3d11/users/79580534dd184cc199146c90f6c913e3/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.835345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82839d8-cdf3-4224-908a-9f78dac4490d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e40ae78b41b409f984925d0c95b3d11, user_id=79580534dd184cc199146c90f6c913e3, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:03.839014 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82839d8-cdf3-4224-908a-9f78dac4490d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:03.857019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1095/2175] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:17:03 2022] PUT /identity/v3/projects/2e40ae78b41b409f984925d0c95b3d11/users/79580534dd184cc199146c90f6c913e3/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:17:03.866563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdc7c2-a2f9-48fc-bbe6-ddd9b888b282 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:03.866843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdc7c2-a2f9-48fc-bbe6-ddd9b888b282 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:03.867124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdc7c2-a2f9-48fc-bbe6-ddd9b888b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:03.897726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b0fdc7c2-a2f9-48fc-bbe6-ddd9b888b282 None None] MFA Rules not processed for user `79580534dd184cc199146c90f6c913e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:03.899010 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b0fdc7c2-a2f9-48fc-bbe6-ddd9b888b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:03.984743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1081/2176] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:03.988928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82839d8-cdf3-4224-908a-9f78dac4490d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:04.003530 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:04.093419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82839d8-cdf3-4224-908a-9f78dac4490d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:04.104926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d41cd8-76cb-4fa4-9f60-6d1cd5c3059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:04.104926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d41cd8-76cb-4fa4-9f60-6d1cd5c3059d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:04.106381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d41cd8-76cb-4fa4-9f60-6d1cd5c3059d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:04.106740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d41cd8-76cb-4fa4-9f60-6d1cd5c3059d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:04.107649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d41cd8-76cb-4fa4-9f60-6d1cd5c3059d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:04.109699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d41cd8-76cb-4fa4-9f60-6d1cd5c3059d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:04.142089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1096/2177] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:17:03 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:17:04.146332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdc7c2-a2f9-48fc-bbe6-ddd9b888b282 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:04.160406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdc7c2-a2f9-48fc-bbe6-ddd9b888b282 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:04.169062 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:04.228282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a709eb-f799-4d17-9a6d-f7e273843df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:04.229148 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a709eb-f799-4d17-9a6d-f7e273843df5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:04.229556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a709eb-f799-4d17-9a6d-f7e273843df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:04.230007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a709eb-f799-4d17-9a6d-f7e273843df5 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:04.230855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a709eb-f799-4d17-9a6d-f7e273843df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:04.233073 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a709eb-f799-4d17-9a6d-f7e273843df5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:04.258367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1082/2178] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:17:04 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:17:04.264174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d41cd8-76cb-4fa4-9f60-6d1cd5c3059d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:04.275973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d41cd8-76cb-4fa4-9f60-6d1cd5c3059d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:04.281836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b317f67-aa68-4ac9-9883-f655426ac06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:04.282795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b317f67-aa68-4ac9-9883-f655426ac06d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:04.282987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b317f67-aa68-4ac9-9883-f655426ac06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:04.283205 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b317f67-aa68-4ac9-9883-f655426ac06d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:04.283994 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b317f67-aa68-4ac9-9883-f655426ac06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:04.285803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b317f67-aa68-4ac9-9883-f655426ac06d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:04.298208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1097/2179] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:17:04.302423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a709eb-f799-4d17-9a6d-f7e273843df5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:04.314099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a709eb-f799-4d17-9a6d-f7e273843df5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:04.319283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4491-9164-49b0-88aa-5167db406e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:04.320393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4491-9164-49b0-88aa-5167db406e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:04.320835 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4491-9164-49b0-88aa-5167db406e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:04.321188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c4491-9164-49b0-88aa-5167db406e4c admin admin] PATH_INFO: `/v3/projects/3bb4699e94d04346bd764c399a802681/users/0253c6ca38bf41d2967ad4e9500835d4/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:04.342669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c4491-9164-49b0-88aa-5167db406e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb4699e94d04346bd764c399a802681, user_id=0253c6ca38bf41d2967ad4e9500835d4, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:04.346725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c4491-9164-49b0-88aa-5167db406e4c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:04.367726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1083/2180] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:17:04 2022] PUT /identity/v3/projects/3bb4699e94d04346bd764c399a802681/users/0253c6ca38bf41d2967ad4e9500835d4/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:04.369555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b317f67-aa68-4ac9-9883-f655426ac06d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:04.380093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b317f67-aa68-4ac9-9883-f655426ac06d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:04.447067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b30f1-9487-4473-be19-7332efe03066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:04.447868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b30f1-9487-4473-be19-7332efe03066 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:04.448167 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b30f1-9487-4473-be19-7332efe03066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:04.448551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b30f1-9487-4473-be19-7332efe03066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:04.449338 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b30f1-9487-4473-be19-7332efe03066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:04.451302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b30f1-9487-4473-be19-7332efe03066 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:04.464153 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1098/2181] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:17:04.468082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4491-9164-49b0-88aa-5167db406e4c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:04.482121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c4491-9164-49b0-88aa-5167db406e4c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:04.487823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8596-7400-43ac-b6ea-130720620750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:04.488838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8596-7400-43ac-b6ea-130720620750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:04.489193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8596-7400-43ac-b6ea-130720620750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:04.489513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8596-7400-43ac-b6ea-130720620750 admin admin] PATH_INFO: `/v3/projects/3bb4699e94d04346bd764c399a802681/users/0253c6ca38bf41d2967ad4e9500835d4/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:04.491774 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b8596-7400-43ac-b6ea-130720620750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb4699e94d04346bd764c399a802681, user_id=0253c6ca38bf41d2967ad4e9500835d4, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:04.496806 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b8596-7400-43ac-b6ea-130720620750 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:04.509905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1084/2182] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:17:04 2022] PUT /identity/v3/projects/3bb4699e94d04346bd764c399a802681/users/0253c6ca38bf41d2967ad4e9500835d4/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:04.521044 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c806df-b831-43ee-bdba-adf30591b7a6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:04.521816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c806df-b831-43ee-bdba-adf30591b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:04.522203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c806df-b831-43ee-bdba-adf30591b7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:04.553086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-40c806df-b831-43ee-bdba-adf30591b7a6 None None] MFA Rules not processed for user `0253c6ca38bf41d2967ad4e9500835d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:04.554325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-40c806df-b831-43ee-bdba-adf30591b7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:04.636486 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1099/2183] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:17:04.647279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8596-7400-43ac-b6ea-130720620750 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:04.649159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-442b8596-7400-43ac-b6ea-130720620750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:04.722785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8596-7400-43ac-b6ea-130720620750 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:04.727214 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1851d-9c0b-46a3-b632-5ced65f526f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:04.728521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1851d-9c0b-46a3-b632-5ced65f526f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:04.728864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1851d-9c0b-46a3-b632-5ced65f526f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:04.729297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1851d-9c0b-46a3-b632-5ced65f526f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:04.798356 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1851d-9c0b-46a3-b632-5ced65f526f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:04.799885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1851d-9c0b-46a3-b632-5ced65f526f1 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:04.811561 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1085/2184] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:17:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:17:14.632604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:14.804995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:16.762225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c806df-b831-43ee-bdba-adf30591b7a6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:16.771699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c806df-b831-43ee-bdba-adf30591b7a6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:16.776318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5adc3-7a83-4abc-b6d1-ebc1e7b13f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:16.776964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5adc3-7a83-4abc-b6d1-ebc1e7b13f2d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:16.777251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5adc3-7a83-4abc-b6d1-ebc1e7b13f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:16.777587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5adc3-7a83-4abc-b6d1-ebc1e7b13f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:16.786940 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5adc3-7a83-4abc-b6d1-ebc1e7b13f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:16.788359 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5adc3-7a83-4abc-b6d1-ebc1e7b13f2d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:16.798439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1100/2185] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:17:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:17:18.516111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a3f7-b83c-4b57-8f2c-b5853e8ec2d7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:18.516568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a3f7-b83c-4b57-8f2c-b5853e8ec2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:18.516668 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a3f7-b83c-4b57-8f2c-b5853e8ec2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:18.534626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-02e4a3f7-b83c-4b57-8f2c-b5853e8ec2d7 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:18.535832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-02e4a3f7-b83c-4b57-8f2c-b5853e8ec2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:18.590838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1086/2186] 10.222.0.90 () {58 vars in 967 bytes} [Tue Jun 21 15:17:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:18.604191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5adc3-7a83-4abc-b6d1-ebc1e7b13f2d service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:18.606281 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7bd5adc3-7a83-4abc-b6d1-ebc1e7b13f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:18.674734 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5adc3-7a83-4abc-b6d1-ebc1e7b13f2d service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:18.680131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c138b-e905-4a2e-9122-4fbeb508d33c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:18.680791 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c138b-e905-4a2e-9122-4fbeb508d33c service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:18.681080 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c138b-e905-4a2e-9122-4fbeb508d33c service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:18.681502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c138b-e905-4a2e-9122-4fbeb508d33c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:18.690880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c138b-e905-4a2e-9122-4fbeb508d33c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:18.692536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c138b-e905-4a2e-9122-4fbeb508d33c service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:18.702143 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1101/2187] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:17:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:17:25.043012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a3f7-b83c-4b57-8f2c-b5853e8ec2d7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:25.044814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-02e4a3f7-b83c-4b57-8f2c-b5853e8ec2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:25.113917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a3f7-b83c-4b57-8f2c-b5853e8ec2d7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:25.118622 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:25.119476 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.119760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.120036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] PATH_INFO: `/v3/users/c4f4604d203640e58297cb491aff59fa` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.121297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f4604d203640e58297cb491aff59fa)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:25.123423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:25.176399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f4604d203640e58297cb491aff59fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.188757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f4604d203640e58297cb491aff59fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.196829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f4604d203640e58297cb491aff59fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.204144 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f4604d203640e58297cb491aff59fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.204787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-95ff20a7-0e7c-4dfa-8b8d-b5df007c6b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f4604d203640e58297cb491aff59fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.210722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1087/2188] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:17:25 2022] DELETE /identity/v3/users/c4f4604d203640e58297cb491aff59fa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:25.385885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c138b-e905-4a2e-9122-4fbeb508d33c service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:25.398029 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c138b-e905-4a2e-9122-4fbeb508d33c service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:25.458937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:25.459798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.460084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.460367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] PATH_INFO: `/v3/projects/2ca28f17bfeb4bc6ad8444182f4ad048` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.461735 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca28f17bfeb4bc6ad8444182f4ad048)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:25.464058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:25.510602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca28f17bfeb4bc6ad8444182f4ad048', 'request_id': 'req-65ce310b-92bf-4518-80f4-8001ea939855'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.516564 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca28f17bfeb4bc6ad8444182f4ad048', 'request_id': 'req-65ce310b-92bf-4518-80f4-8001ea939855'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.522300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca28f17bfeb4bc6ad8444182f4ad048', 'request_id': 'req-65ce310b-92bf-4518-80f4-8001ea939855'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.534796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] The token cache is being invalidate because project 2ca28f17bfeb4bc6ad8444182f4ad048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:17:25.535213 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.535835 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ce310b-92bf-4518-80f4-8001ea939855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:25.537365 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1102/2189] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:17:25 2022] DELETE /identity/v3/projects/2ca28f17bfeb4bc6ad8444182f4ad048 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:25.543185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663f105-6d22-4c61-8ba6-a5e09f56bd95 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.543472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663f105-6d22-4c61-8ba6-a5e09f56bd95 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.543753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663f105-6d22-4c61-8ba6-a5e09f56bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.562748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2663f105-6d22-4c61-8ba6-a5e09f56bd95 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:25.563952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2663f105-6d22-4c61-8ba6-a5e09f56bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:25.583181 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:25.626571 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1088/2190] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:25.634597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ef09b-9115-400f-8767-268c5685c6e0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.634891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ef09b-9115-400f-8767-268c5685c6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.635185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ef09b-9115-400f-8767-268c5685c6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.647423 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:25.654565 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1e6ef09b-9115-400f-8767-268c5685c6e0 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:25.656720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1e6ef09b-9115-400f-8767-268c5685c6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:25.666018 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1103/2191] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:25.670336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663f105-6d22-4c61-8ba6-a5e09f56bd95 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:25.679970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663f105-6d22-4c61-8ba6-a5e09f56bd95 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:25.685287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452369-a7cc-4491-b762-0929a046188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:25.686039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452369-a7cc-4491-b762-0929a046188a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.686328 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452369-a7cc-4491-b762-0929a046188a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.686603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452369-a7cc-4491-b762-0929a046188a admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.687322 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92452369-a7cc-4491-b762-0929a046188a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:17:25.687629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92452369-a7cc-4491-b762-0929a046188a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:25.689210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92452369-a7cc-4491-b762-0929a046188a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:25.700666 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1089/2192] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:17:25.704890 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ef09b-9115-400f-8767-268c5685c6e0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:25.714603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ef09b-9115-400f-8767-268c5685c6e0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:25.719696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da10153-8590-43cb-95e9-481ac23fcdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:25.720353 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da10153-8590-43cb-95e9-481ac23fcdfa admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.720665 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da10153-8590-43cb-95e9-481ac23fcdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.721047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da10153-8590-43cb-95e9-481ac23fcdfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.721775 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da10153-8590-43cb-95e9-481ac23fcdfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:25.723662 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da10153-8590-43cb-95e9-481ac23fcdfa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:25.754546 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1104/2193] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:17:25 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:17:25.759262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452369-a7cc-4491-b762-0929a046188a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:25.769255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452369-a7cc-4491-b762-0929a046188a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:25.826452 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a4fbe-8e12-4e0d-af43-3a8ca95439b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:25.827119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4fbe-8e12-4e0d-af43-3a8ca95439b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.827405 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4fbe-8e12-4e0d-af43-3a8ca95439b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.827684 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4fbe-8e12-4e0d-af43-3a8ca95439b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.828386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a4fbe-8e12-4e0d-af43-3a8ca95439b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:25.830335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a4fbe-8e12-4e0d-af43-3a8ca95439b5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:25.851023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1090/2194] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:17:25 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:17:25.855789 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da10153-8590-43cb-95e9-481ac23fcdfa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:25.866019 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da10153-8590-43cb-95e9-481ac23fcdfa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:25.871733 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fdf36-79d3-4f02-b174-8061cd865af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:25.872389 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fdf36-79d3-4f02-b174-8061cd865af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.872677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fdf36-79d3-4f02-b174-8061cd865af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.872958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fdf36-79d3-4f02-b174-8061cd865af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.873729 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fdf36-79d3-4f02-b174-8061cd865af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:25.875322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fdf36-79d3-4f02-b174-8061cd865af6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:25.891242 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1105/2195] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:17:25.895140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a4fbe-8e12-4e0d-af43-3a8ca95439b5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:25.905349 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a4fbe-8e12-4e0d-af43-3a8ca95439b5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:25.910334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dab4f9-4101-46ee-b8fc-645fd852bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:25.910983 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dab4f9-4101-46ee-b8fc-645fd852bd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.911270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dab4f9-4101-46ee-b8fc-645fd852bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.911548 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dab4f9-4101-46ee-b8fc-645fd852bd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.912272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dab4f9-4101-46ee-b8fc-645fd852bd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:25.913904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dab4f9-4101-46ee-b8fc-645fd852bd17 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:25.924870 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1091/2196] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:17:25.928966 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fdf36-79d3-4f02-b174-8061cd865af6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:25.940024 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fdf36-79d3-4f02-b174-8061cd865af6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:25.944807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d907f8-9c02-42a1-a926-6b47469a46d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:25.945704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d907f8-9c02-42a1-a926-6b47469a46d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.946090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d907f8-9c02-42a1-a926-6b47469a46d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.946864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d907f8-9c02-42a1-a926-6b47469a46d1 admin admin] PATH_INFO: `/v3/projects/93d1d9e023ce4742b2873b698cf70f5a/users/ee664f14e3f345698730b3ce152a4275/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:25.962451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d907f8-9c02-42a1-a926-6b47469a46d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d1d9e023ce4742b2873b698cf70f5a, user_id=ee664f14e3f345698730b3ce152a4275, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:25.965118 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d907f8-9c02-42a1-a926-6b47469a46d1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:25.978642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1106/2197] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:17:25 2022] PUT /identity/v3/projects/93d1d9e023ce4742b2873b698cf70f5a/users/ee664f14e3f345698730b3ce152a4275/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:25.988531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d3b35-b5f2-4f7a-b93c-e9c51000e15c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:25.988841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d3b35-b5f2-4f7a-b93c-e9c51000e15c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:25.989108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d3b35-b5f2-4f7a-b93c-e9c51000e15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:26.016497 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ef8d3b35-b5f2-4f7a-b93c-e9c51000e15c None None] MFA Rules not processed for user `ee664f14e3f345698730b3ce152a4275`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:26.017710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ef8d3b35-b5f2-4f7a-b93c-e9c51000e15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:26.088730 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1092/2198] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:26.099401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d907f8-9c02-42a1-a926-6b47469a46d1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:26.101119 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9d907f8-9c02-42a1-a926-6b47469a46d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:26.162109 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d907f8-9c02-42a1-a926-6b47469a46d1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:26.166888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762697a-0e0b-4d22-a13e-f298d2c245bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:26.167537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762697a-0e0b-4d22-a13e-f298d2c245bb service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:26.167823 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762697a-0e0b-4d22-a13e-f298d2c245bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:26.168104 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762697a-0e0b-4d22-a13e-f298d2c245bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:26.176478 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762697a-0e0b-4d22-a13e-f298d2c245bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:26.177945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762697a-0e0b-4d22-a13e-f298d2c245bb service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:26.187840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1107/2199] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:17:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:17:36.085779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:36.183798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:46.107110 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547c30-0394-42a9-9b43-f9bca3732764 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:46.107662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547c30-0394-42a9-9b43-f9bca3732764 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:46.107775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547c30-0394-42a9-9b43-f9bca3732764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:46.125673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-58547c30-0394-42a9-9b43-f9bca3732764 None None] MFA Rules not processed for user `a46beb5fe7d145d5aa0a821c471f2dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:46.126874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-58547c30-0394-42a9-9b43-f9bca3732764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:46.190270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1093/2200] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:55.274479 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762697a-0e0b-4d22-a13e-f298d2c245bb service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:55.348588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762697a-0e0b-4d22-a13e-f298d2c245bb service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:55.354454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:55.355527 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:55.356291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:55.356801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] PATH_INFO: `/v3/users/ee664f14e3f345698730b3ce152a4275` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:55.358123 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee664f14e3f345698730b3ce152a4275)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:55.360301 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:55.412079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee664f14e3f345698730b3ce152a4275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:55.424476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee664f14e3f345698730b3ce152a4275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:55.432403 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee664f14e3f345698730b3ce152a4275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:55.433150 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee664f14e3f345698730b3ce152a4275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:55.433778 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee664f14e3f345698730b3ce152a4275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:55.448434 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1108/2201] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:17:55 2022] DELETE /identity/v3/users/ee664f14e3f345698730b3ce152a4275 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:55.452871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2846f2-ab9c-46cb-8ad3-4f4af20f0368 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:55.453366 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2846f2-ab9c-46cb-8ad3-4f4af20f0368 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:55.453499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2846f2-ab9c-46cb-8ad3-4f4af20f0368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:55.471275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8e2846f2-ab9c-46cb-8ad3-4f4af20f0368 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:55.472521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e2846f2-ab9c-46cb-8ad3-4f4af20f0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:55.533932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1094/2202] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:55.543529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:55.544923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:55.602699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effad97d-f49d-4b72-8ed5-a48440a229eb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:55.606408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c7a30-da21-4741-9c3e-6b2bccdbb184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:55.607047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7a30-da21-4741-9c3e-6b2bccdbb184 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:55.607331 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7a30-da21-4741-9c3e-6b2bccdbb184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:55.607607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c7a30-da21-4741-9c3e-6b2bccdbb184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:55.619737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c7a30-da21-4741-9c3e-6b2bccdbb184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:55.622362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c7a30-da21-4741-9c3e-6b2bccdbb184 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:55.632309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1109/2203] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:17:55.950623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2846f2-ab9c-46cb-8ad3-4f4af20f0368 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:55.952541 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e2846f2-ab9c-46cb-8ad3-4f4af20f0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:55.965430 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2846f2-ab9c-46cb-8ad3-4f4af20f0368 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:55.970237 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:55.971102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:55.971386 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:55.971663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] PATH_INFO: `/v3/projects/93d1d9e023ce4742b2873b698cf70f5a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:55.972866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d1d9e023ce4742b2873b698cf70f5a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:55.974834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:56.029041 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d1d9e023ce4742b2873b698cf70f5a', 'request_id': 'req-03b1810b-1ed4-4296-8369-1e5328023835'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.037330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d1d9e023ce4742b2873b698cf70f5a', 'request_id': 'req-03b1810b-1ed4-4296-8369-1e5328023835'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.044082 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d1d9e023ce4742b2873b698cf70f5a', 'request_id': 'req-03b1810b-1ed4-4296-8369-1e5328023835'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.056776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] The token cache is being invalidate because project 93d1d9e023ce4742b2873b698cf70f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:17:56.057078 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.057757 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-03b1810b-1ed4-4296-8369-1e5328023835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.059290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1095/2204] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:17:55 2022] DELETE /identity/v3/projects/93d1d9e023ce4742b2873b698cf70f5a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:56.117052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c7a30-da21-4741-9c3e-6b2bccdbb184 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:56.118963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1c7c7a30-da21-4741-9c3e-6b2bccdbb184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:56.138125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c7a30-da21-4741-9c3e-6b2bccdbb184 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:56.169204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:56.228769 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:56.229975 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:56.230288 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:56.230667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] PATH_INFO: `/v3/users/79580534dd184cc199146c90f6c913e3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:56.232327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79580534dd184cc199146c90f6c913e3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:56.236193 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:56.296762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79580534dd184cc199146c90f6c913e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.311266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79580534dd184cc199146c90f6c913e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.318310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79580534dd184cc199146c90f6c913e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.319087 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79580534dd184cc199146c90f6c913e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.319756 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79580534dd184cc199146c90f6c913e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.334749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1110/2205] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:17:56 2022] DELETE /identity/v3/users/79580534dd184cc199146c90f6c913e3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:56.339811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf5632-6a30-4bde-aa8f-934f4a8177b4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:56.340097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf5632-6a30-4bde-aa8f-934f4a8177b4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:56.340378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf5632-6a30-4bde-aa8f-934f4a8177b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:56.365459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8adf5632-6a30-4bde-aa8f-934f4a8177b4 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:56.366679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8adf5632-6a30-4bde-aa8f-934f4a8177b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:56.394715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:56.434531 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1096/2206] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:56.444580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:56.447312 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:56.512745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231bc5-e649-49b1-a5b7-7739e57a21d2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:56.518138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b286bdf-1e2d-4f90-8fcc-ff0729bd1084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:56.519138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b286bdf-1e2d-4f90-8fcc-ff0729bd1084 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:56.519612 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b286bdf-1e2d-4f90-8fcc-ff0729bd1084 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:56.520045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b286bdf-1e2d-4f90-8fcc-ff0729bd1084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:56.534676 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b286bdf-1e2d-4f90-8fcc-ff0729bd1084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:56.536977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b286bdf-1e2d-4f90-8fcc-ff0729bd1084 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:56.552710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1111/2207] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:17:56.834628 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf5632-6a30-4bde-aa8f-934f4a8177b4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:56.837027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8adf5632-6a30-4bde-aa8f-934f4a8177b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:56.858661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf5632-6a30-4bde-aa8f-934f4a8177b4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:56.864885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:56.865844 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:56.866201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:56.866398 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] PATH_INFO: `/v3/projects/2e40ae78b41b409f984925d0c95b3d11` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:56.868367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e40ae78b41b409f984925d0c95b3d11)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:56.870447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:56.925512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e40ae78b41b409f984925d0c95b3d11', 'request_id': 'req-c3651574-f564-4dc6-8b04-28664359c9a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.935213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e40ae78b41b409f984925d0c95b3d11', 'request_id': 'req-c3651574-f564-4dc6-8b04-28664359c9a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.941390 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e40ae78b41b409f984925d0c95b3d11', 'request_id': 'req-c3651574-f564-4dc6-8b04-28664359c9a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.953451 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] The token cache is being invalidate because project 2e40ae78b41b409f984925d0c95b3d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:17:56.953811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.954415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:56.956052 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1097/2208] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:17:56 2022] DELETE /identity/v3/projects/2e40ae78b41b409f984925d0c95b3d11 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:56.960318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b286bdf-1e2d-4f90-8fcc-ff0729bd1084 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:56.970926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b286bdf-1e2d-4f90-8fcc-ff0729bd1084 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:57.015660 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:57.036304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:57.037689 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:57.038123 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:57.038559 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] PATH_INFO: `/v3/users/0253c6ca38bf41d2967ad4e9500835d4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:57.040583 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0253c6ca38bf41d2967ad4e9500835d4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:57.043810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:57.093745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0253c6ca38bf41d2967ad4e9500835d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.106170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0253c6ca38bf41d2967ad4e9500835d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.113086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0253c6ca38bf41d2967ad4e9500835d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.113978 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0253c6ca38bf41d2967ad4e9500835d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.114722 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-033546f4-848c-4e3c-8865-627efa980686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0253c6ca38bf41d2967ad4e9500835d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.131198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1112/2209] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:17:56 2022] DELETE /identity/v3/users/0253c6ca38bf41d2967ad4e9500835d4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:17:57.436980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:57.438872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:57.456204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3651574-f564-4dc6-8b04-28664359c9a5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:57.544586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:57.545895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:57.546407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:57.546914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] PATH_INFO: `/v3/projects/3bb4699e94d04346bd764c399a802681` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:57.549029 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb4699e94d04346bd764c399a802681)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:57.551629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:57.613140 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb4699e94d04346bd764c399a802681', 'request_id': 'req-519d4e1f-b341-403d-b51c-c49bcb10c425'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.616714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:57.621931 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb4699e94d04346bd764c399a802681', 'request_id': 'req-519d4e1f-b341-403d-b51c-c49bcb10c425'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.629722 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb4699e94d04346bd764c399a802681', 'request_id': 'req-519d4e1f-b341-403d-b51c-c49bcb10c425'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.641847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] The token cache is being invalidate because project 3bb4699e94d04346bd764c399a802681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:17:57.642142 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.642811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-519d4e1f-b341-403d-b51c-c49bcb10c425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:57.644369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1098/2210] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:17:57 2022] DELETE /identity/v3/projects/3bb4699e94d04346bd764c399a802681 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:57.650468 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4bb64-e46d-4e9a-bb20-65c52e77dee5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:57.650952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4bb64-e46d-4e9a-bb20-65c52e77dee5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:57.651065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4bb64-e46d-4e9a-bb20-65c52e77dee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:57.671373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-86f4bb64-e46d-4e9a-bb20-65c52e77dee5 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:57.672598 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86f4bb64-e46d-4e9a-bb20-65c52e77dee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:57.735419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1113/2211] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:57.743220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe3a6-6071-4e04-bbc0-6f800642045f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:57.743551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe3a6-6071-4e04-bbc0-6f800642045f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:57.743988 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe3a6-6071-4e04-bbc0-6f800642045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:57.764758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-90ebe3a6-6071-4e04-bbc0-6f800642045f None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:57.765960 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-90ebe3a6-6071-4e04-bbc0-6f800642045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:57.775226 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1099/2212] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:57.779640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4bb64-e46d-4e9a-bb20-65c52e77dee5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:57.790548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4bb64-e46d-4e9a-bb20-65c52e77dee5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:57.795220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1335e3e-3c3f-4c26-bd49-ada1f20c9d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:57.795816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1335e3e-3c3f-4c26-bd49-ada1f20c9d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:57.796101 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1335e3e-3c3f-4c26-bd49-ada1f20c9d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:57.796383 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1335e3e-3c3f-4c26-bd49-ada1f20c9d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:57.797117 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1335e3e-3c3f-4c26-bd49-ada1f20c9d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:17:57.797430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1335e3e-3c3f-4c26-bd49-ada1f20c9d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:57.799066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1335e3e-3c3f-4c26-bd49-ada1f20c9d38 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:57.810906 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1114/2213] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:17:57.815415 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebe3a6-6071-4e04-bbc0-6f800642045f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:57.825066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebe3a6-6071-4e04-bbc0-6f800642045f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:57.829783 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dd3d7-6d17-41c6-8c09-7a5905b27e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:57.830428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dd3d7-6d17-41c6-8c09-7a5905b27e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:57.830710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dd3d7-6d17-41c6-8c09-7a5905b27e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:57.830983 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dd3d7-6d17-41c6-8c09-7a5905b27e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:57.831672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dd3d7-6d17-41c6-8c09-7a5905b27e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:57.833629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dd3d7-6d17-41c6-8c09-7a5905b27e85 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:57.861836 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1100/2214] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:17:57 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:17:57.864092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1335e3e-3c3f-4c26-bd49-ada1f20c9d38 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:57.875243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1335e3e-3c3f-4c26-bd49-ada1f20c9d38 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:57.925302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:57.937368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291a825-e9bc-4fe6-a87d-6ca78994e31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:57.938366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291a825-e9bc-4fe6-a87d-6ca78994e31c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:57.938863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291a825-e9bc-4fe6-a87d-6ca78994e31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:57.939249 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291a825-e9bc-4fe6-a87d-6ca78994e31c admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:57.940251 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291a825-e9bc-4fe6-a87d-6ca78994e31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:57.942238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291a825-e9bc-4fe6-a87d-6ca78994e31c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:57.967033 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1115/2215] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:17:57 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:17:57.968472 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dd3d7-6d17-41c6-8c09-7a5905b27e85 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:57.980419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dd3d7-6d17-41c6-8c09-7a5905b27e85 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:57.985027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069419b-c5e1-4a87-88aa-175160819cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:57.985715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069419b-c5e1-4a87-88aa-175160819cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:57.985999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069419b-c5e1-4a87-88aa-175160819cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:57.986278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069419b-c5e1-4a87-88aa-175160819cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:57.987014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069419b-c5e1-4a87-88aa-175160819cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:57.988609 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069419b-c5e1-4a87-88aa-175160819cc9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:57.999327 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1101/2216] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:17:58.003754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291a825-e9bc-4fe6-a87d-6ca78994e31c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:58.014589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291a825-e9bc-4fe6-a87d-6ca78994e31c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:58.020185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4a6fb-133f-40ae-aef2-5d8a01d7782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:58.020878 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4a6fb-133f-40ae-aef2-5d8a01d7782b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.021159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4a6fb-133f-40ae-aef2-5d8a01d7782b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.021619 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4a6fb-133f-40ae-aef2-5d8a01d7782b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.022206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4a6fb-133f-40ae-aef2-5d8a01d7782b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:58.024435 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4a6fb-133f-40ae-aef2-5d8a01d7782b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:58.037441 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1116/2217] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:17:58.042218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069419b-c5e1-4a87-88aa-175160819cc9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:58.053150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069419b-c5e1-4a87-88aa-175160819cc9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:58.057900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1e21a-7759-4a9b-b74d-109d39d0caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:58.058776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1e21a-7759-4a9b-b74d-109d39d0caf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.059061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1e21a-7759-4a9b-b74d-109d39d0caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.059341 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1e21a-7759-4a9b-b74d-109d39d0caf9 admin admin] PATH_INFO: `/v3/projects/2ddf30f936ef4d00a46175a0338fe50e/users/19ef4434d1214b76b53d27fcfe8cb75e/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.074615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1e21a-7759-4a9b-b74d-109d39d0caf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ddf30f936ef4d00a46175a0338fe50e, user_id=19ef4434d1214b76b53d27fcfe8cb75e, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:58.077245 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1e21a-7759-4a9b-b74d-109d39d0caf9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:58.090690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1102/2218] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:17:58 2022] PUT /identity/v3/projects/2ddf30f936ef4d00a46175a0338fe50e/users/19ef4434d1214b76b53d27fcfe8cb75e/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:58.101872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276629f0-7e88-41e6-9ae9-0dda407cb1d7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.102196 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276629f0-7e88-41e6-9ae9-0dda407cb1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.102688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276629f0-7e88-41e6-9ae9-0dda407cb1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.129445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-276629f0-7e88-41e6-9ae9-0dda407cb1d7 None None] MFA Rules not processed for user `19ef4434d1214b76b53d27fcfe8cb75e`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:58.130855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-276629f0-7e88-41e6-9ae9-0dda407cb1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:58.197638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1117/2219] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:58.202176 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1e21a-7759-4a9b-b74d-109d39d0caf9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:58.264589 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1e21a-7759-4a9b-b74d-109d39d0caf9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:58.269293 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c96ea-52c8-42a0-857e-50a470c02ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:58.269986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c96ea-52c8-42a0-857e-50a470c02ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.270273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c96ea-52c8-42a0-857e-50a470c02ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.270554 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c96ea-52c8-42a0-857e-50a470c02ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.271264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c96ea-52c8-42a0-857e-50a470c02ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:58.273213 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c96ea-52c8-42a0-857e-50a470c02ca8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:58.309547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1103/2220] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:17:58 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:17:58.313398 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276629f0-7e88-41e6-9ae9-0dda407cb1d7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:58.329172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276629f0-7e88-41e6-9ae9-0dda407cb1d7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:58.387637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad604f0a-9544-41a4-a87c-91091cc97859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:58.388318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad604f0a-9544-41a4-a87c-91091cc97859 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.388603 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad604f0a-9544-41a4-a87c-91091cc97859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.388884 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad604f0a-9544-41a4-a87c-91091cc97859 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.389628 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad604f0a-9544-41a4-a87c-91091cc97859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:58.391539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad604f0a-9544-41a4-a87c-91091cc97859 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:58.412562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1118/2221] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:17:58 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:17:58.416755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c96ea-52c8-42a0-857e-50a470c02ca8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:58.428517 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c96ea-52c8-42a0-857e-50a470c02ca8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:58.434361 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710065b3-1e9d-4799-9783-306aeab16b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:58.435199 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710065b3-1e9d-4799-9783-306aeab16b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.435453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710065b3-1e9d-4799-9783-306aeab16b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.435794 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710065b3-1e9d-4799-9783-306aeab16b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.436606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710065b3-1e9d-4799-9783-306aeab16b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:58.438268 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710065b3-1e9d-4799-9783-306aeab16b8c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:58.449962 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1104/2222] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:17:58.454631 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad604f0a-9544-41a4-a87c-91091cc97859 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:58.466177 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad604f0a-9544-41a4-a87c-91091cc97859 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:58.470822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524a675-1221-48b8-b9ce-faa2d7275657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:58.471702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524a675-1221-48b8-b9ce-faa2d7275657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.471987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524a675-1221-48b8-b9ce-faa2d7275657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.472265 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524a675-1221-48b8-b9ce-faa2d7275657 admin admin] PATH_INFO: `/v3/projects/d6bfb2b0b801493b881d186eb2387aee/users/3473a2cc9a684337aaebdabfc29cb7d3/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.487522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524a675-1221-48b8-b9ce-faa2d7275657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bfb2b0b801493b881d186eb2387aee, user_id=3473a2cc9a684337aaebdabfc29cb7d3, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:58.490225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524a675-1221-48b8-b9ce-faa2d7275657 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:58.504625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1119/2223] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:17:58 2022] PUT /identity/v3/projects/d6bfb2b0b801493b881d186eb2387aee/users/3473a2cc9a684337aaebdabfc29cb7d3/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:58.509819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710065b3-1e9d-4799-9783-306aeab16b8c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:58.520114 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710065b3-1e9d-4799-9783-306aeab16b8c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:58.578540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:58.592132 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a12b8-e664-491e-96db-b40c61a09cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:58.592863 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a12b8-e664-491e-96db-b40c61a09cba admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.593409 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a12b8-e664-491e-96db-b40c61a09cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.593864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a12b8-e664-491e-96db-b40c61a09cba admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.594883 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a12b8-e664-491e-96db-b40c61a09cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:58.596510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a12b8-e664-491e-96db-b40c61a09cba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:58.612309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1105/2224] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:17:58.617126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524a675-1221-48b8-b9ce-faa2d7275657 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:58.629039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524a675-1221-48b8-b9ce-faa2d7275657 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:58.634533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14873b33-2ef5-43cb-944e-5f41ab57630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:58.635412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14873b33-2ef5-43cb-944e-5f41ab57630f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.635696 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14873b33-2ef5-43cb-944e-5f41ab57630f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.635976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14873b33-2ef5-43cb-944e-5f41ab57630f admin admin] PATH_INFO: `/v3/projects/d6bfb2b0b801493b881d186eb2387aee/users/3473a2cc9a684337aaebdabfc29cb7d3/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.638021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14873b33-2ef5-43cb-944e-5f41ab57630f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bfb2b0b801493b881d186eb2387aee, user_id=3473a2cc9a684337aaebdabfc29cb7d3, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:58.640748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14873b33-2ef5-43cb-944e-5f41ab57630f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:58.652073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1120/2225] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:17:58 2022] PUT /identity/v3/projects/d6bfb2b0b801493b881d186eb2387aee/users/3473a2cc9a684337aaebdabfc29cb7d3/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:58.662981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bf36c-77b9-4e6d-9bb0-d3afb6983bc1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.663273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bf36c-77b9-4e6d-9bb0-d3afb6983bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.663556 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bf36c-77b9-4e6d-9bb0-d3afb6983bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.691907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5c9bf36c-77b9-4e6d-9bb0-d3afb6983bc1 None None] MFA Rules not processed for user `3473a2cc9a684337aaebdabfc29cb7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:58.693813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5c9bf36c-77b9-4e6d-9bb0-d3afb6983bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:58.799129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1106/2226] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:17:58.808779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14873b33-2ef5-43cb-944e-5f41ab57630f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:58.811586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-14873b33-2ef5-43cb-944e-5f41ab57630f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:58.833767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:58.886965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14873b33-2ef5-43cb-944e-5f41ab57630f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:58.890611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972e45d-2229-4254-89c7-b2c76fad9bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:58.891438 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972e45d-2229-4254-89c7-b2c76fad9bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:58.891723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972e45d-2229-4254-89c7-b2c76fad9bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:58.891999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972e45d-2229-4254-89c7-b2c76fad9bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:58.902049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972e45d-2229-4254-89c7-b2c76fad9bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:58.903468 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972e45d-2229-4254-89c7-b2c76fad9bb0 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:58.913599 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1121/2227] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:17:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:17:59.047480 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bf36c-77b9-4e6d-9bb0-d3afb6983bc1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:59.114292 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bf36c-77b9-4e6d-9bb0-d3afb6983bc1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:59.119704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:59.120564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:59.120846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:59.121122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] PATH_INFO: `/v3/users/19ef4434d1214b76b53d27fcfe8cb75e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:59.122420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ef4434d1214b76b53d27fcfe8cb75e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:59.124346 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:59.176801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ef4434d1214b76b53d27fcfe8cb75e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.189578 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ef4434d1214b76b53d27fcfe8cb75e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.197827 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ef4434d1214b76b53d27fcfe8cb75e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.202783 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:17:59.205579 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ef4434d1214b76b53d27fcfe8cb75e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.206625 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ef4434d1214b76b53d27fcfe8cb75e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.214348 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1107/2228] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:17:59 2022] DELETE /identity/v3/users/19ef4434d1214b76b53d27fcfe8cb75e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:59.219161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8602a4-a07d-4af5-8762-b72e939e693d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:59.219505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8602a4-a07d-4af5-8762-b72e939e693d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:59.219893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8602a4-a07d-4af5-8762-b72e939e693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:59.237195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8c8602a4-a07d-4af5-8762-b72e939e693d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:17:59.238469 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8c8602a4-a07d-4af5-8762-b72e939e693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:59.299829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1122/2229] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:17:59.310566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:59.312041 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:59.371232 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191e59d-c5bc-4ed4-96da-0adae834aacf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:59.374848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557a752-9232-430f-ad95-7d43be138686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:59.375496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a752-9232-430f-ad95-7d43be138686 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:59.375785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a752-9232-430f-ad95-7d43be138686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:59.376064 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a752-9232-430f-ad95-7d43be138686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:59.386172 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557a752-9232-430f-ad95-7d43be138686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:59.387615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557a752-9232-430f-ad95-7d43be138686 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:59.397380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1108/2230] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:17:59.678428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8602a4-a07d-4af5-8762-b72e939e693d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:59.680341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8c8602a4-a07d-4af5-8762-b72e939e693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:17:59.697406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8602a4-a07d-4af5-8762-b72e939e693d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:59.702626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:59.703496 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:59.703783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:59.704061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] PATH_INFO: `/v3/projects/2ddf30f936ef4d00a46175a0338fe50e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:59.705287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ddf30f936ef4d00a46175a0338fe50e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:59.707358 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:59.756171 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ddf30f936ef4d00a46175a0338fe50e', 'request_id': 'req-91c173de-fd15-4065-b18e-718899fa5934'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.763289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ddf30f936ef4d00a46175a0338fe50e', 'request_id': 'req-91c173de-fd15-4065-b18e-718899fa5934'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.769185 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ddf30f936ef4d00a46175a0338fe50e', 'request_id': 'req-91c173de-fd15-4065-b18e-718899fa5934'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.783207 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] The token cache is being invalidate because project 2ddf30f936ef4d00a46175a0338fe50e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:17:59.783494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.784112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.785677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1123/2231] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:17:59 2022] DELETE /identity/v3/projects/2ddf30f936ef4d00a46175a0338fe50e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:17:59.789986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557a752-9232-430f-ad95-7d43be138686 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:17:59.799637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557a752-9232-430f-ad95-7d43be138686 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:17:59.861018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:17:59.861983 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:17:59.862262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:17:59.862542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] PATH_INFO: `/v3/users/3473a2cc9a684337aaebdabfc29cb7d3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:17:59.863755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3473a2cc9a684337aaebdabfc29cb7d3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:17:59.865682 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:17:59.928991 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3473a2cc9a684337aaebdabfc29cb7d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.949441 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3473a2cc9a684337aaebdabfc29cb7d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.963878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3473a2cc9a684337aaebdabfc29cb7d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.976729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3473a2cc9a684337aaebdabfc29cb7d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.979014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19c0f181-c174-4b22-8369-3fe85b46784d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3473a2cc9a684337aaebdabfc29cb7d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:17:59.986521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1109/2232] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:17:59 2022] DELETE /identity/v3/users/3473a2cc9a684337aaebdabfc29cb7d3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:00.274972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:00.277348 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:00.296055 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c173de-fd15-4065-b18e-718899fa5934 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:00.341409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:00.368059 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:00.368895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.369181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.369462 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] PATH_INFO: `/v3/projects/d6bfb2b0b801493b881d186eb2387aee` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.370763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bfb2b0b801493b881d186eb2387aee)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:00.372704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:00.421364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bfb2b0b801493b881d186eb2387aee', 'request_id': 'req-20f901d2-a091-453d-9d9b-26c59b76771a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:00.427486 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bfb2b0b801493b881d186eb2387aee', 'request_id': 'req-20f901d2-a091-453d-9d9b-26c59b76771a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:00.433942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bfb2b0b801493b881d186eb2387aee', 'request_id': 'req-20f901d2-a091-453d-9d9b-26c59b76771a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:00.447687 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] The token cache is being invalidate because project d6bfb2b0b801493b881d186eb2387aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:18:00.447897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:00.448522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20f901d2-a091-453d-9d9b-26c59b76771a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:00.450128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1124/2233] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:18:00 2022] DELETE /identity/v3/projects/d6bfb2b0b801493b881d186eb2387aee => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:00.455124 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc43a-8f9e-4a92-9134-ebe3976d133d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.455623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc43a-8f9e-4a92-9134-ebe3976d133d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.455749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc43a-8f9e-4a92-9134-ebe3976d133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.473290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b38cc43a-8f9e-4a92-9134-ebe3976d133d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:00.474512 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b38cc43a-8f9e-4a92-9134-ebe3976d133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:00.484008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:00.536676 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1110/2234] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:00.557243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d68ab-37bb-4610-a6d3-0e9e1d946d7d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.557750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d68ab-37bb-4610-a6d3-0e9e1d946d7d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.558178 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d68ab-37bb-4610-a6d3-0e9e1d946d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.584816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-558d68ab-37bb-4610-a6d3-0e9e1d946d7d None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:00.586782 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-558d68ab-37bb-4610-a6d3-0e9e1d946d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:00.598283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1125/2235] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:00.602624 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc43a-8f9e-4a92-9134-ebe3976d133d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:00.612520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc43a-8f9e-4a92-9134-ebe3976d133d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:00.617051 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cf633-3121-4534-adf6-a383cf0c076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:00.618335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf633-3121-4534-adf6-a383cf0c076c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.618621 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf633-3121-4534-adf6-a383cf0c076c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.618900 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf633-3121-4534-adf6-a383cf0c076c admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.619635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cf633-3121-4534-adf6-a383cf0c076c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:18:00.619946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cf633-3121-4534-adf6-a383cf0c076c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:00.621566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cf633-3121-4534-adf6-a383cf0c076c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:00.633885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1111/2236] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 15:18:00.638424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d68ab-37bb-4610-a6d3-0e9e1d946d7d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:00.647879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d68ab-37bb-4610-a6d3-0e9e1d946d7d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:00.653054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370621-da3e-41b9-b77a-641776a69089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:00.653737 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370621-da3e-41b9-b77a-641776a69089 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.654056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370621-da3e-41b9-b77a-641776a69089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.654333 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370621-da3e-41b9-b77a-641776a69089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.655039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5370621-da3e-41b9-b77a-641776a69089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:00.657198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5370621-da3e-41b9-b77a-641776a69089 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:00.684047 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1126/2237] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:18:00 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:18:00.688582 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cf633-3121-4534-adf6-a383cf0c076c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:00.699843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cf633-3121-4534-adf6-a383cf0c076c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:00.762663 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411091e-bea8-4dfd-86cb-8cc943e45553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:00.763339 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411091e-bea8-4dfd-86cb-8cc943e45553 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.763631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411091e-bea8-4dfd-86cb-8cc943e45553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.763911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411091e-bea8-4dfd-86cb-8cc943e45553 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.764635 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411091e-bea8-4dfd-86cb-8cc943e45553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:00.766591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411091e-bea8-4dfd-86cb-8cc943e45553 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:00.787458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1112/2238] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:18:00 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:18:00.792472 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370621-da3e-41b9-b77a-641776a69089 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:00.802912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370621-da3e-41b9-b77a-641776a69089 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:00.808710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66eac1-c6ba-4ad4-b3c1-d338d1458f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:00.809367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66eac1-c6ba-4ad4-b3c1-d338d1458f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.809688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66eac1-c6ba-4ad4-b3c1-d338d1458f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.809972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66eac1-c6ba-4ad4-b3c1-d338d1458f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.810704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66eac1-c6ba-4ad4-b3c1-d338d1458f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:00.812312 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66eac1-c6ba-4ad4-b3c1-d338d1458f99 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:00.824567 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1127/2239] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:18:00.828554 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411091e-bea8-4dfd-86cb-8cc943e45553 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:00.838882 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411091e-bea8-4dfd-86cb-8cc943e45553 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:00.843511 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd818eb-54af-4f1b-8fb2-7d05f1ef73f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:00.844164 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd818eb-54af-4f1b-8fb2-7d05f1ef73f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.844448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd818eb-54af-4f1b-8fb2-7d05f1ef73f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.844724 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd818eb-54af-4f1b-8fb2-7d05f1ef73f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.845447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd818eb-54af-4f1b-8fb2-7d05f1ef73f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:00.847159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd818eb-54af-4f1b-8fb2-7d05f1ef73f8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:00.858171 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1113/2240] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:18:00.862394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66eac1-c6ba-4ad4-b3c1-d338d1458f99 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:00.873875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66eac1-c6ba-4ad4-b3c1-d338d1458f99 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:00.878677 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff116-2dbb-4ed1-9453-5d5f036bf084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:00.879537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff116-2dbb-4ed1-9453-5d5f036bf084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.879824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff116-2dbb-4ed1-9453-5d5f036bf084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.880105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff116-2dbb-4ed1-9453-5d5f036bf084 admin admin] PATH_INFO: `/v3/projects/560018e2df8f4cd59ac1b2f0c17d0808/users/a3686d184f3545d0bd87c544e72ce163/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.896078 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff116-2dbb-4ed1-9453-5d5f036bf084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560018e2df8f4cd59ac1b2f0c17d0808, user_id=a3686d184f3545d0bd87c544e72ce163, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:00.899362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff116-2dbb-4ed1-9453-5d5f036bf084 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:00.913355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1128/2241] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:18:00 2022] PUT /identity/v3/projects/560018e2df8f4cd59ac1b2f0c17d0808/users/a3686d184f3545d0bd87c544e72ce163/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:00.925005 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517e127-3779-4dba-b44e-a00ed7caff80 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:00.925296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517e127-3779-4dba-b44e-a00ed7caff80 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:00.925608 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517e127-3779-4dba-b44e-a00ed7caff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:00.953464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7517e127-3779-4dba-b44e-a00ed7caff80 None None] MFA Rules not processed for user `a3686d184f3545d0bd87c544e72ce163`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:00.954627 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7517e127-3779-4dba-b44e-a00ed7caff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:01.022420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1114/2242] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:18:01.027225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff116-2dbb-4ed1-9453-5d5f036bf084 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:01.117701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff116-2dbb-4ed1-9453-5d5f036bf084 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:01.124210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38517f-768d-4853-a005-7f010734b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:01.124897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38517f-768d-4853-a005-7f010734b72d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:01.125174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38517f-768d-4853-a005-7f010734b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:01.125456 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38517f-768d-4853-a005-7f010734b72d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:01.126181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38517f-768d-4853-a005-7f010734b72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:01.128097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38517f-768d-4853-a005-7f010734b72d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:01.138262 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:01.162291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1129/2243] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:18:01 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:18:01.167965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517e127-3779-4dba-b44e-a00ed7caff80 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:01.181564 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517e127-3779-4dba-b44e-a00ed7caff80 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:01.194968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:01.247103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa26cd5-9b6f-42e6-a8c8-af42746620f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:01.247693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa26cd5-9b6f-42e6-a8c8-af42746620f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:01.248063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa26cd5-9b6f-42e6-a8c8-af42746620f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:01.248347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa26cd5-9b6f-42e6-a8c8-af42746620f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:01.249055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa26cd5-9b6f-42e6-a8c8-af42746620f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:01.251018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa26cd5-9b6f-42e6-a8c8-af42746620f3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:01.272969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1115/2244] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:18:01 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:18:01.277294 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38517f-768d-4853-a005-7f010734b72d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:01.287886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38517f-768d-4853-a005-7f010734b72d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:01.293238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313069b8-fbdc-4c44-8c92-963ff6e09244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:01.293928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313069b8-fbdc-4c44-8c92-963ff6e09244 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:01.294210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313069b8-fbdc-4c44-8c92-963ff6e09244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:01.294500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313069b8-fbdc-4c44-8c92-963ff6e09244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:01.295219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313069b8-fbdc-4c44-8c92-963ff6e09244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:01.296803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313069b8-fbdc-4c44-8c92-963ff6e09244 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:01.307627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1130/2245] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:18:01.311946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa26cd5-9b6f-42e6-a8c8-af42746620f3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:01.323438 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa26cd5-9b6f-42e6-a8c8-af42746620f3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:01.328426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f30ad-3a2d-48a2-a701-2f8a20f25b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:01.329372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f30ad-3a2d-48a2-a701-2f8a20f25b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:01.329687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f30ad-3a2d-48a2-a701-2f8a20f25b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:01.329965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f30ad-3a2d-48a2-a701-2f8a20f25b44 admin admin] PATH_INFO: `/v3/projects/c54bb7b3de114e8988ba425dcea234ed/users/9d3dcd9b26ce46fda5799a1bdc71d1bc/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:01.345656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f30ad-3a2d-48a2-a701-2f8a20f25b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54bb7b3de114e8988ba425dcea234ed, user_id=9d3dcd9b26ce46fda5799a1bdc71d1bc, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:01.348298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f30ad-3a2d-48a2-a701-2f8a20f25b44 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:01.362371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1116/2246] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:18:01 2022] PUT /identity/v3/projects/c54bb7b3de114e8988ba425dcea234ed/users/9d3dcd9b26ce46fda5799a1bdc71d1bc/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:01.366684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313069b8-fbdc-4c44-8c92-963ff6e09244 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:01.377501 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313069b8-fbdc-4c44-8c92-963ff6e09244 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:01.434209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0090c13-3aa5-4048-a301-205a986daa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:01.434870 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0090c13-3aa5-4048-a301-205a986daa22 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:01.435159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0090c13-3aa5-4048-a301-205a986daa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:01.435432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0090c13-3aa5-4048-a301-205a986daa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:01.436152 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0090c13-3aa5-4048-a301-205a986daa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:01.437781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0090c13-3aa5-4048-a301-205a986daa22 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:01.448399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1131/2247] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:18:01.452803 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f30ad-3a2d-48a2-a701-2f8a20f25b44 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:01.463946 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f30ad-3a2d-48a2-a701-2f8a20f25b44 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:01.468799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcde74-6dbd-4a5f-9a27-3f779dc45bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:01.469758 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcde74-6dbd-4a5f-9a27-3f779dc45bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:01.470045 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcde74-6dbd-4a5f-9a27-3f779dc45bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:01.470325 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcde74-6dbd-4a5f-9a27-3f779dc45bce admin admin] PATH_INFO: `/v3/projects/c54bb7b3de114e8988ba425dcea234ed/users/9d3dcd9b26ce46fda5799a1bdc71d1bc/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:01.472284 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcde74-6dbd-4a5f-9a27-3f779dc45bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54bb7b3de114e8988ba425dcea234ed, user_id=9d3dcd9b26ce46fda5799a1bdc71d1bc, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:01.474959 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcde74-6dbd-4a5f-9a27-3f779dc45bce admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:01.485935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1117/2248] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:18:01 2022] PUT /identity/v3/projects/c54bb7b3de114e8988ba425dcea234ed/users/9d3dcd9b26ce46fda5799a1bdc71d1bc/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:01.501430 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c8d6f-5ec7-4da5-8ef9-4070804a08d4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:01.501836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c8d6f-5ec7-4da5-8ef9-4070804a08d4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:01.502257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c8d6f-5ec7-4da5-8ef9-4070804a08d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:01.542017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6d8c8d6f-5ec7-4da5-8ef9-4070804a08d4 None None] MFA Rules not processed for user `9d3dcd9b26ce46fda5799a1bdc71d1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:01.543773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d8c8d6f-5ec7-4da5-8ef9-4070804a08d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:01.644585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1132/2249] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:01.656734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcde74-6dbd-4a5f-9a27-3f779dc45bce admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:01.658511 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b7bcde74-6dbd-4a5f-9a27-3f779dc45bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:01.717076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcde74-6dbd-4a5f-9a27-3f779dc45bce admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:01.721808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b33357-0719-4626-863c-b577380b0785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:01.722449 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b33357-0719-4626-863c-b577380b0785 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:01.722729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b33357-0719-4626-863c-b577380b0785 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:01.723008 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b33357-0719-4626-863c-b577380b0785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:01.732263 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b33357-0719-4626-863c-b577380b0785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:01.733715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b33357-0719-4626-863c-b577380b0785 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:01.743072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1118/2250] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:02.172659 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c8d6f-5ec7-4da5-8ef9-4070804a08d4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:02.256051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c8d6f-5ec7-4da5-8ef9-4070804a08d4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:02.262838 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:02.263839 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:02.264123 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:02.264401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] PATH_INFO: `/v3/users/a3686d184f3545d0bd87c544e72ce163` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:02.266112 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3686d184f3545d0bd87c544e72ce163)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:02.268191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:02.271275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:02.334829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3686d184f3545d0bd87c544e72ce163'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:02.350697 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3686d184f3545d0bd87c544e72ce163'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:02.363081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3686d184f3545d0bd87c544e72ce163'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:02.363897 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3686d184f3545d0bd87c544e72ce163'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:02.364517 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3686d184f3545d0bd87c544e72ce163'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:02.385510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1133/2251] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:18:02 2022] DELETE /identity/v3/users/a3686d184f3545d0bd87c544e72ce163 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:02.387523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a06cd-0a32-412d-b85d-1984bf431793 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:02.387735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a06cd-0a32-412d-b85d-1984bf431793 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:02.388023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a06cd-0a32-412d-b85d-1984bf431793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:02.411377 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dc0a06cd-0a32-412d-b85d-1984bf431793 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:02.412603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dc0a06cd-0a32-412d-b85d-1984bf431793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:02.475166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1119/2252] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:18:02.485343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:02.486973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:02.546942 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adafa8a-8546-4400-833c-2399ef65b913 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:02.550497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e384fa-6df4-44b0-b085-341a7a37ac1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:02.551139 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e384fa-6df4-44b0-b085-341a7a37ac1c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:02.551426 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e384fa-6df4-44b0-b085-341a7a37ac1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:02.551703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e384fa-6df4-44b0-b085-341a7a37ac1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:02.561244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e384fa-6df4-44b0-b085-341a7a37ac1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:02.562734 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e384fa-6df4-44b0-b085-341a7a37ac1c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:02.573077 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1134/2253] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:02.881294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a06cd-0a32-412d-b85d-1984bf431793 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:02.883640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dc0a06cd-0a32-412d-b85d-1984bf431793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:02.898014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a06cd-0a32-412d-b85d-1984bf431793 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:02.904049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:02.905258 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:02.905971 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:02.906592 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] PATH_INFO: `/v3/projects/560018e2df8f4cd59ac1b2f0c17d0808` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:02.908102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560018e2df8f4cd59ac1b2f0c17d0808)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:02.910553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:02.912357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:02.965568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560018e2df8f4cd59ac1b2f0c17d0808', 'request_id': 'req-15a7e718-5eb3-4a28-9e84-93736e8e0e15'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:02.973929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560018e2df8f4cd59ac1b2f0c17d0808', 'request_id': 'req-15a7e718-5eb3-4a28-9e84-93736e8e0e15'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:02.980922 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560018e2df8f4cd59ac1b2f0c17d0808', 'request_id': 'req-15a7e718-5eb3-4a28-9e84-93736e8e0e15'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:02.997884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] The token cache is being invalidate because project 560018e2df8f4cd59ac1b2f0c17d0808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:18:02.998127 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:02.998810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.000408 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1120/2254] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:18:02 2022] DELETE /identity/v3/projects/560018e2df8f4cd59ac1b2f0c17d0808 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:03.004424 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e384fa-6df4-44b0-b085-341a7a37ac1c service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:03.014683 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e384fa-6df4-44b0-b085-341a7a37ac1c service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:03.079608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:03.080649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:03.080938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:03.081222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] PATH_INFO: `/v3/users/9d3dcd9b26ce46fda5799a1bdc71d1bc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:03.082515 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3dcd9b26ce46fda5799a1bdc71d1bc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:03.084508 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:03.109829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:03.147368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3dcd9b26ce46fda5799a1bdc71d1bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.163216 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3dcd9b26ce46fda5799a1bdc71d1bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.171437 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3dcd9b26ce46fda5799a1bdc71d1bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.172212 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3dcd9b26ce46fda5799a1bdc71d1bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.173098 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a4f4075-d39a-454a-b5a2-11c0c75336df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3dcd9b26ce46fda5799a1bdc71d1bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.198129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1135/2255] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:18:03 2022] DELETE /identity/v3/users/9d3dcd9b26ce46fda5799a1bdc71d1bc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:18:03.510559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:03.512090 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:03.533372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7e718-5eb3-4a28-9e84-93736e8e0e15 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:03.610828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:03.611599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:03.612083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:03.612303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] PATH_INFO: `/v3/projects/c54bb7b3de114e8988ba425dcea234ed` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:03.613557 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54bb7b3de114e8988ba425dcea234ed)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:03.615572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:03.675197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54bb7b3de114e8988ba425dcea234ed', 'request_id': 'req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.684953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54bb7b3de114e8988ba425dcea234ed', 'request_id': 'req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.691294 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54bb7b3de114e8988ba425dcea234ed', 'request_id': 'req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.710142 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] The token cache is being invalidate because project c54bb7b3de114e8988ba425dcea234ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:18:03.710640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.713290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c76ca129-33b9-43c0-8c44-fc68ca6dae3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:03.716016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1121/2256] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:18:03 2022] DELETE /identity/v3/projects/c54bb7b3de114e8988ba425dcea234ed => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:18:03.724798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f3bb-3e6b-4418-8865-6f01f7707e7c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:03.725203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f3bb-3e6b-4418-8865-6f01f7707e7c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:03.726176 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f3bb-3e6b-4418-8865-6f01f7707e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:03.751191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c933f3bb-3e6b-4418-8865-6f01f7707e7c None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:03.752716 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c933f3bb-3e6b-4418-8865-6f01f7707e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:03.829902 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1136/2257] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:03.839236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbe036-6456-4a41-8394-04dd69ef5d70 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:03.839523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbe036-6456-4a41-8394-04dd69ef5d70 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:03.839807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbe036-6456-4a41-8394-04dd69ef5d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:03.861776 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5bbbe036-6456-4a41-8394-04dd69ef5d70 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:03.863884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5bbbe036-6456-4a41-8394-04dd69ef5d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:03.874385 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1122/2258] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:18:03.878618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933f3bb-3e6b-4418-8865-6f01f7707e7c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:03.889888 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933f3bb-3e6b-4418-8865-6f01f7707e7c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:03.894554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fbf10-3d3d-45b7-843b-ebef3ea1c133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:03.895220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fbf10-3d3d-45b7-843b-ebef3ea1c133 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:03.895522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fbf10-3d3d-45b7-843b-ebef3ea1c133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:03.895795 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fbf10-3d3d-45b7-843b-ebef3ea1c133 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:03.896528 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fbf10-3d3d-45b7-843b-ebef3ea1c133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:18:03.896844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fbf10-3d3d-45b7-843b-ebef3ea1c133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:03.899232 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fbf10-3d3d-45b7-843b-ebef3ea1c133 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:03.912445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1137/2259] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:18:03.917894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbe036-6456-4a41-8394-04dd69ef5d70 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:03.933044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbe036-6456-4a41-8394-04dd69ef5d70 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:03.939338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d58c-d887-43e1-9cb0-2ae606ec7487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:03.940241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d58c-d887-43e1-9cb0-2ae606ec7487 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:03.940701 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d58c-d887-43e1-9cb0-2ae606ec7487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:03.941046 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d58c-d887-43e1-9cb0-2ae606ec7487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:03.942088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077d58c-d887-43e1-9cb0-2ae606ec7487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:03.944948 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077d58c-d887-43e1-9cb0-2ae606ec7487 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:03.958781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:03.977343 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1123/2260] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:18:03 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:18:03.981704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fbf10-3d3d-45b7-843b-ebef3ea1c133 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:03.991837 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fbf10-3d3d-45b7-843b-ebef3ea1c133 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.049154 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bf196-a562-4430-8a91-cf505910ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.049858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bf196-a562-4430-8a91-cf505910ccc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.050145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bf196-a562-4430-8a91-cf505910ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.050425 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bf196-a562-4430-8a91-cf505910ccc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.051126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bf196-a562-4430-8a91-cf505910ccc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.053096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bf196-a562-4430-8a91-cf505910ccc8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.073089 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1138/2261] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:18:03 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:18:04.077393 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d58c-d887-43e1-9cb0-2ae606ec7487 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.088502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d58c-d887-43e1-9cb0-2ae606ec7487 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.093434 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c1a90-802c-45c5-a0d7-d4964ff9712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.094229 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c1a90-802c-45c5-a0d7-d4964ff9712b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.094513 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c1a90-802c-45c5-a0d7-d4964ff9712b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.094791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c1a90-802c-45c5-a0d7-d4964ff9712b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.095529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c1a90-802c-45c5-a0d7-d4964ff9712b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.097131 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c1a90-802c-45c5-a0d7-d4964ff9712b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.108467 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1124/2262] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:18:04.112982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bf196-a562-4430-8a91-cf505910ccc8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.124044 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bf196-a562-4430-8a91-cf505910ccc8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.128703 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d549c-9439-4ec2-80ed-b7b930e08ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.129364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d549c-9439-4ec2-80ed-b7b930e08ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.129680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d549c-9439-4ec2-80ed-b7b930e08ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.129964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d549c-9439-4ec2-80ed-b7b930e08ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.130693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d549c-9439-4ec2-80ed-b7b930e08ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.132291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d549c-9439-4ec2-80ed-b7b930e08ff5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.143476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1139/2263] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:18:04.148004 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c1a90-802c-45c5-a0d7-d4964ff9712b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.160453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c1a90-802c-45c5-a0d7-d4964ff9712b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.166197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e166-3c2e-4871-bfed-f15f70f163eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.167091 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e166-3c2e-4871-bfed-f15f70f163eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.167376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e166-3c2e-4871-bfed-f15f70f163eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.167677 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e166-3c2e-4871-bfed-f15f70f163eb admin admin] PATH_INFO: `/v3/projects/270ff1530fe3495ea43f98b72f0ee47e/users/38dafc2fde384e49afe911591a4dc5ce/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.186296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399e166-3c2e-4871-bfed-f15f70f163eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=270ff1530fe3495ea43f98b72f0ee47e, user_id=38dafc2fde384e49afe911591a4dc5ce, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.188954 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399e166-3c2e-4871-bfed-f15f70f163eb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.203111 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1125/2264] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:18:04 2022] PUT /identity/v3/projects/270ff1530fe3495ea43f98b72f0ee47e/users/38dafc2fde384e49afe911591a4dc5ce/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:04.213779 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de238b-6909-4d1d-b87d-dcdd38ccbb3e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.214314 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de238b-6909-4d1d-b87d-dcdd38ccbb3e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.214462 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de238b-6909-4d1d-b87d-dcdd38ccbb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.227415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:04.244723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a0de238b-6909-4d1d-b87d-dcdd38ccbb3e None None] MFA Rules not processed for user `38dafc2fde384e49afe911591a4dc5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:04.245965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a0de238b-6909-4d1d-b87d-dcdd38ccbb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:04.311798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1140/2265] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:04.316407 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e166-3c2e-4871-bfed-f15f70f163eb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.384336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e166-3c2e-4871-bfed-f15f70f163eb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.391018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1202-325f-4cfa-bbae-bb6ff147f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.391904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1202-325f-4cfa-bbae-bb6ff147f19f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.392193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1202-325f-4cfa-bbae-bb6ff147f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.392474 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1202-325f-4cfa-bbae-bb6ff147f19f admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.393189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1202-325f-4cfa-bbae-bb6ff147f19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.395152 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1202-325f-4cfa-bbae-bb6ff147f19f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.422631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1126/2266] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:18:04 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:18:04.426719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de238b-6909-4d1d-b87d-dcdd38ccbb3e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.439007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de238b-6909-4d1d-b87d-dcdd38ccbb3e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.502013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4212ae5-6dcd-40f7-b3f7-7b439a172715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.502695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4212ae5-6dcd-40f7-b3f7-7b439a172715 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.502981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4212ae5-6dcd-40f7-b3f7-7b439a172715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.503257 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4212ae5-6dcd-40f7-b3f7-7b439a172715 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.503960 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4212ae5-6dcd-40f7-b3f7-7b439a172715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.505912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4212ae5-6dcd-40f7-b3f7-7b439a172715 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.528067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1141/2267] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:18:04 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:18:04.532510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1202-325f-4cfa-bbae-bb6ff147f19f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.543604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1202-325f-4cfa-bbae-bb6ff147f19f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.548320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16774f6-a78d-41d7-bf4b-4243571e0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.548981 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16774f6-a78d-41d7-bf4b-4243571e0f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.549275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16774f6-a78d-41d7-bf4b-4243571e0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.549586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16774f6-a78d-41d7-bf4b-4243571e0f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.550318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16774f6-a78d-41d7-bf4b-4243571e0f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.551917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16774f6-a78d-41d7-bf4b-4243571e0f0b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.564195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1127/2268] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:18:04.568219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4212ae5-6dcd-40f7-b3f7-7b439a172715 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.579368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4212ae5-6dcd-40f7-b3f7-7b439a172715 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.583990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ae9c5-5165-400b-b35b-720bf0e09619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.584643 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ae9c5-5165-400b-b35b-720bf0e09619 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.584933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ae9c5-5165-400b-b35b-720bf0e09619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.585209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ae9c5-5165-400b-b35b-720bf0e09619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.586097 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ae9c5-5165-400b-b35b-720bf0e09619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.587836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ae9c5-5165-400b-b35b-720bf0e09619 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.597899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1142/2269] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:18:04.603251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16774f6-a78d-41d7-bf4b-4243571e0f0b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.618521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16774f6-a78d-41d7-bf4b-4243571e0f0b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.626020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dc5fb-4b41-406a-846b-4bc986e27a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.626942 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dc5fb-4b41-406a-846b-4bc986e27a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.627227 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dc5fb-4b41-406a-846b-4bc986e27a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.627507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dc5fb-4b41-406a-846b-4bc986e27a98 admin admin] PATH_INFO: `/v3/projects/f83efe98fdf846258eac10895b7e6eb8/users/22187819ea2a43ca8ccca1700dbd823f/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.644828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dc5fb-4b41-406a-846b-4bc986e27a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83efe98fdf846258eac10895b7e6eb8, user_id=22187819ea2a43ca8ccca1700dbd823f, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.647599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dc5fb-4b41-406a-846b-4bc986e27a98 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.680866 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1128/2270] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:18:04 2022] PUT /identity/v3/projects/f83efe98fdf846258eac10895b7e6eb8/users/22187819ea2a43ca8ccca1700dbd823f/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:04.684096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274cbe0-725a-466f-b3e2-bf8025f1d861 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.684751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274cbe0-725a-466f-b3e2-bf8025f1d861 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.685293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274cbe0-725a-466f-b3e2-bf8025f1d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.723087 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0274cbe0-725a-466f-b3e2-bf8025f1d861 None None] MFA Rules not processed for user `22187819ea2a43ca8ccca1700dbd823f`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:04.725899 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0274cbe0-725a-466f-b3e2-bf8025f1d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:04.841844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1143/2271] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:04.843563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dc5fb-4b41-406a-846b-4bc986e27a98 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.936893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dc5fb-4b41-406a-846b-4bc986e27a98 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:04.942889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5089-6187-48a8-a689-a5623f38e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:04.944269 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5089-6187-48a8-a689-a5623f38e9ef admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:04.944558 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5089-6187-48a8-a689-a5623f38e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:04.944843 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5089-6187-48a8-a689-a5623f38e9ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:04.946239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f5089-6187-48a8-a689-a5623f38e9ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:04.948189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f5089-6187-48a8-a689-a5623f38e9ef admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:04.960852 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:04.979657 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1129/2272] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:18:04 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:18:04.984144 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274cbe0-725a-466f-b3e2-bf8025f1d861 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:04.991373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:04.996253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274cbe0-725a-466f-b3e2-bf8025f1d861 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:05.062237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277dd8-c017-4ade-91de-42939cdcf112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:05.063802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277dd8-c017-4ade-91de-42939cdcf112 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:05.064304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277dd8-c017-4ade-91de-42939cdcf112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:05.064744 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277dd8-c017-4ade-91de-42939cdcf112 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:05.066086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09277dd8-c017-4ade-91de-42939cdcf112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:05.070446 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09277dd8-c017-4ade-91de-42939cdcf112 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:05.102861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1144/2273] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:18:04 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:18:05.106937 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5089-6187-48a8-a689-a5623f38e9ef admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:05.119315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5089-6187-48a8-a689-a5623f38e9ef admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:05.125360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61482c29-eabc-4d38-a91b-7dc65e74e514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:05.126987 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61482c29-eabc-4d38-a91b-7dc65e74e514 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:05.127399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61482c29-eabc-4d38-a91b-7dc65e74e514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:05.127773 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61482c29-eabc-4d38-a91b-7dc65e74e514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:05.128999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61482c29-eabc-4d38-a91b-7dc65e74e514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:05.131652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61482c29-eabc-4d38-a91b-7dc65e74e514 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:05.147417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1130/2274] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:18:05.152129 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277dd8-c017-4ade-91de-42939cdcf112 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:05.166000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277dd8-c017-4ade-91de-42939cdcf112 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:05.172357 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdd254-5017-4288-9870-8a9efce5a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:05.173381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdd254-5017-4288-9870-8a9efce5a6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:05.173811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdd254-5017-4288-9870-8a9efce5a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:05.174215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdd254-5017-4288-9870-8a9efce5a6d4 admin admin] PATH_INFO: `/v3/projects/9113b7a39707498bba4441087ee90b56/users/998695caf84742dc980c315b50ead876/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:05.201625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdd254-5017-4288-9870-8a9efce5a6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9113b7a39707498bba4441087ee90b56, user_id=998695caf84742dc980c315b50ead876, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:05.206878 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdd254-5017-4288-9870-8a9efce5a6d4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:05.225195 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1145/2275] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:18:05 2022] PUT /identity/v3/projects/9113b7a39707498bba4441087ee90b56/users/998695caf84742dc980c315b50ead876/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:05.232296 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61482c29-eabc-4d38-a91b-7dc65e74e514 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:05.243685 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61482c29-eabc-4d38-a91b-7dc65e74e514 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:05.310367 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d28ab-00e8-45fc-adf5-b350ca256282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:05.311047 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d28ab-00e8-45fc-adf5-b350ca256282 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:05.311325 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d28ab-00e8-45fc-adf5-b350ca256282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:05.311603 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d28ab-00e8-45fc-adf5-b350ca256282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:05.312335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d28ab-00e8-45fc-adf5-b350ca256282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:05.314105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d28ab-00e8-45fc-adf5-b350ca256282 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:05.324527 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1131/2276] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:18:05.328987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdd254-5017-4288-9870-8a9efce5a6d4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:05.340387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdd254-5017-4288-9870-8a9efce5a6d4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:05.345792 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c65dcf-d759-41da-aa1a-8e862d5fc56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:05.346704 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c65dcf-d759-41da-aa1a-8e862d5fc56d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:05.346993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c65dcf-d759-41da-aa1a-8e862d5fc56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:05.347276 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c65dcf-d759-41da-aa1a-8e862d5fc56d admin admin] PATH_INFO: `/v3/projects/9113b7a39707498bba4441087ee90b56/users/998695caf84742dc980c315b50ead876/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:05.349259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c65dcf-d759-41da-aa1a-8e862d5fc56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9113b7a39707498bba4441087ee90b56, user_id=998695caf84742dc980c315b50ead876, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:05.352770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c65dcf-d759-41da-aa1a-8e862d5fc56d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:05.363304 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1146/2277] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:18:05 2022] PUT /identity/v3/projects/9113b7a39707498bba4441087ee90b56/users/998695caf84742dc980c315b50ead876/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:05.375601 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a91e5-114f-48a2-9f5f-97e5ef585b39 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:05.375888 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a91e5-114f-48a2-9f5f-97e5ef585b39 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:05.376167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a91e5-114f-48a2-9f5f-97e5ef585b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:05.403304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-959a91e5-114f-48a2-9f5f-97e5ef585b39 None None] MFA Rules not processed for user `998695caf84742dc980c315b50ead876`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:05.404534 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-959a91e5-114f-48a2-9f5f-97e5ef585b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:05.475094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1132/2278] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:05.488551 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c65dcf-d759-41da-aa1a-8e862d5fc56d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:05.490420 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89c65dcf-d759-41da-aa1a-8e862d5fc56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:05.550726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c65dcf-d759-41da-aa1a-8e862d5fc56d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:05.554450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31883cd-1983-42e6-9a39-21f864c67e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:05.556252 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31883cd-1983-42e6-9a39-21f864c67e38 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:05.556667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31883cd-1983-42e6-9a39-21f864c67e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:05.556957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31883cd-1983-42e6-9a39-21f864c67e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:05.618328 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31883cd-1983-42e6-9a39-21f864c67e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:05.619768 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31883cd-1983-42e6-9a39-21f864c67e38 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:05.629106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1147/2279] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:07.268329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a91e5-114f-48a2-9f5f-97e5ef585b39 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:07.271104 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-959a91e5-114f-48a2-9f5f-97e5ef585b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:07.287417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a91e5-114f-48a2-9f5f-97e5ef585b39 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:07.293277 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccca1d5-87b6-4329-a200-50b82d03febe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:07.294675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccca1d5-87b6-4329-a200-50b82d03febe service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:07.295122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccca1d5-87b6-4329-a200-50b82d03febe service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:07.295569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccca1d5-87b6-4329-a200-50b82d03febe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:07.374364 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccca1d5-87b6-4329-a200-50b82d03febe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:07.375828 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccca1d5-87b6-4329-a200-50b82d03febe service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:07.381313 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:07.389585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1133/2280] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:07.994066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31883cd-1983-42e6-9a39-21f864c67e38 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:08.002701 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31883cd-1983-42e6-9a39-21f864c67e38 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:08.006362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1600d1d-6236-4e74-a01d-d984ea324155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:08.006998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1600d1d-6236-4e74-a01d-d984ea324155 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:08.007283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1600d1d-6236-4e74-a01d-d984ea324155 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:08.007562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1600d1d-6236-4e74-a01d-d984ea324155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:08.017445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1600d1d-6236-4e74-a01d-d984ea324155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:08.019115 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1600d1d-6236-4e74-a01d-d984ea324155 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:08.023860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:08.034349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1148/2281] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:18:08.672028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccca1d5-87b6-4329-a200-50b82d03febe service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:08.673872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7ccca1d5-87b6-4329-a200-50b82d03febe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:08.739360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccca1d5-87b6-4329-a200-50b82d03febe service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:08.745028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5e676-268b-4344-a8f7-0082db1ee848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:08.745808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e676-268b-4344-a8f7-0082db1ee848 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:08.746098 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e676-268b-4344-a8f7-0082db1ee848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:08.746496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e676-268b-4344-a8f7-0082db1ee848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:08.748723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36d5e676-268b-4344-a8f7-0082db1ee848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:08.825411 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5e676-268b-4344-a8f7-0082db1ee848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:08.826872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5e676-268b-4344-a8f7-0082db1ee848 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:08.836672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1134/2282] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:13.216409 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1600d1d-6236-4e74-a01d-d984ea324155 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:13.283090 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1600d1d-6236-4e74-a01d-d984ea324155 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:13.287718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:13.288589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:13.288882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:13.289829 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] PATH_INFO: `/v3/users/38dafc2fde384e49afe911591a4dc5ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:13.291044 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38dafc2fde384e49afe911591a4dc5ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:13.292962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:13.341618 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38dafc2fde384e49afe911591a4dc5ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.353993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38dafc2fde384e49afe911591a4dc5ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.360927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38dafc2fde384e49afe911591a4dc5ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.361708 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38dafc2fde384e49afe911591a4dc5ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.362332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38dafc2fde384e49afe911591a4dc5ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.377253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1149/2283] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:18:13 2022] DELETE /identity/v3/users/38dafc2fde384e49afe911591a4dc5ce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:13.381984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebe312-c4f0-4e50-ac06-689930d548b6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:13.382478 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebe312-c4f0-4e50-ac06-689930d548b6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:13.383204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebe312-c4f0-4e50-ac06-689930d548b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:13.400044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b6ebe312-c4f0-4e50-ac06-689930d548b6 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:13.401256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b6ebe312-c4f0-4e50-ac06-689930d548b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:13.470939 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1135/2284] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:13.481767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:13.483173 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:13.547821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8d462-b628-4b88-bfc4-4b103883e867 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:13.552807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a86a2e-dc60-48bf-aaaa-94ec84df092f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:13.553742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a86a2e-dc60-48bf-aaaa-94ec84df092f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:13.554127 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a86a2e-dc60-48bf-aaaa-94ec84df092f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:13.555058 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a86a2e-dc60-48bf-aaaa-94ec84df092f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:13.566851 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a86a2e-dc60-48bf-aaaa-94ec84df092f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:13.568258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a86a2e-dc60-48bf-aaaa-94ec84df092f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:13.578479 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1150/2285] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:13.882012 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebe312-c4f0-4e50-ac06-689930d548b6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:13.883778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b6ebe312-c4f0-4e50-ac06-689930d548b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:13.904529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebe312-c4f0-4e50-ac06-689930d548b6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:13.909887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:13.910755 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:13.911048 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:13.911326 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] PATH_INFO: `/v3/projects/270ff1530fe3495ea43f98b72f0ee47e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:13.912581 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] RBAC: Authorizing `identity:delete_project(project_id=270ff1530fe3495ea43f98b72f0ee47e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:13.915741 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:13.967909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:13.971572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270ff1530fe3495ea43f98b72f0ee47e', 'request_id': 'req-41dcd8a1-e427-44e8-9d7b-3b765b22411c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.979697 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270ff1530fe3495ea43f98b72f0ee47e', 'request_id': 'req-41dcd8a1-e427-44e8-9d7b-3b765b22411c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.985521 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270ff1530fe3495ea43f98b72f0ee47e', 'request_id': 'req-41dcd8a1-e427-44e8-9d7b-3b765b22411c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.996693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] The token cache is being invalidate because project 270ff1530fe3495ea43f98b72f0ee47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:18:13.996980 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.997648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:13.999184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1136/2286] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:18:13 2022] DELETE /identity/v3/projects/270ff1530fe3495ea43f98b72f0ee47e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:14.003948 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a86a2e-dc60-48bf-aaaa-94ec84df092f service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:14.016083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a86a2e-dc60-48bf-aaaa-94ec84df092f service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:14.035196 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:14.083054 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:14.083925 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:14.084210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:14.084489 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] PATH_INFO: `/v3/users/22187819ea2a43ca8ccca1700dbd823f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:14.086575 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=22187819ea2a43ca8ccca1700dbd823f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:14.088743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:14.140518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22187819ea2a43ca8ccca1700dbd823f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.159287 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22187819ea2a43ca8ccca1700dbd823f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.167680 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22187819ea2a43ca8ccca1700dbd823f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.168419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22187819ea2a43ca8ccca1700dbd823f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.169031 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22187819ea2a43ca8ccca1700dbd823f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.185021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1151/2287] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:18:14 2022] DELETE /identity/v3/users/22187819ea2a43ca8ccca1700dbd823f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:14.547034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:14.549898 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:14.563914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcd8a1-e427-44e8-9d7b-3b765b22411c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:14.645733 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:14.646645 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:14.647094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:14.647384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] PATH_INFO: `/v3/projects/f83efe98fdf846258eac10895b7e6eb8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:14.649224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83efe98fdf846258eac10895b7e6eb8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:14.651936 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:14.709175 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83efe98fdf846258eac10895b7e6eb8', 'request_id': 'req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.718725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83efe98fdf846258eac10895b7e6eb8', 'request_id': 'req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.731335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83efe98fdf846258eac10895b7e6eb8', 'request_id': 'req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.743233 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] The token cache is being invalidate because project f83efe98fdf846258eac10895b7e6eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:18:14.743542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.744174 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.745786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1137/2288] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:18:14 2022] DELETE /identity/v3/projects/f83efe98fdf846258eac10895b7e6eb8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:14.750497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:14.752500 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:14.765891 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae752-66c4-4bf0-ac6a-5e2f7c4c0bae admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:14.831959 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:14.832750 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:14.833034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:14.833311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] PATH_INFO: `/v3/users/998695caf84742dc980c315b50ead876` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:14.834537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=998695caf84742dc980c315b50ead876)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:14.837163 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:14.878094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:14.884399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998695caf84742dc980c315b50ead876'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.897887 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998695caf84742dc980c315b50ead876'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.906156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998695caf84742dc980c315b50ead876'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.906861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998695caf84742dc980c315b50ead876'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.907465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df2937dd-d24f-4fb5-8ea7-b4c8a7a4d676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998695caf84742dc980c315b50ead876'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:14.921821 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1152/2289] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:18:14 2022] DELETE /identity/v3/users/998695caf84742dc980c315b50ead876 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:18:15.213671 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:15.215204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:15.231363 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d8efe-f82a-4e6b-8772-8ab4caa16995 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:15.290709 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:15.291565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:15.291850 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:15.292129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] PATH_INFO: `/v3/projects/9113b7a39707498bba4441087ee90b56` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:15.293299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9113b7a39707498bba4441087ee90b56)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:15.295222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:15.301499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:15.344417 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9113b7a39707498bba4441087ee90b56', 'request_id': 'req-47ca5760-88ef-4347-a0e8-63303b9c7b08'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:15.352808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9113b7a39707498bba4441087ee90b56', 'request_id': 'req-47ca5760-88ef-4347-a0e8-63303b9c7b08'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:15.358995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9113b7a39707498bba4441087ee90b56', 'request_id': 'req-47ca5760-88ef-4347-a0e8-63303b9c7b08'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:15.371526 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] The token cache is being invalidate because project 9113b7a39707498bba4441087ee90b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:18:15.371823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:15.372481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:18:15.374230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1138/2290] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:18:15 2022] DELETE /identity/v3/projects/9113b7a39707498bba4441087ee90b56 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:18:19.870625 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894ca9-6e53-43bd-a48a-39cde340cc04 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:19.871120 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894ca9-6e53-43bd-a48a-39cde340cc04 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:19.871412 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894ca9-6e53-43bd-a48a-39cde340cc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:19.888938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-89894ca9-6e53-43bd-a48a-39cde340cc04 None None] MFA Rules not processed for user `d56ce8a772d7417eb4224f3e13cc0759`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:19.890222 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89894ca9-6e53-43bd-a48a-39cde340cc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:19.959006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1153/2291] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:18:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:25.367779 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:25.894484 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:25.895891 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:25.996626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca5760-88ef-4347-a0e8-63303b9c7b08 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:26.002185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ac2738bf434afabe3d227dc5e52650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:26.003167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:26.003662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:26.004112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:26.006788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:26.088195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:26.089725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:26.101382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1139/2292] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:26.440477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89894ca9-6e53-43bd-a48a-39cde340cc04 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:26.441919 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89894ca9-6e53-43bd-a48a-39cde340cc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:26.501021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89894ca9-6e53-43bd-a48a-39cde340cc04 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:26.504621 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c857856-5eee-4945-a765-fcfff0cc275a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:26.505265 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c857856-5eee-4945-a765-fcfff0cc275a service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:26.505582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c857856-5eee-4945-a765-fcfff0cc275a service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:26.505865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c857856-5eee-4945-a765-fcfff0cc275a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:26.507632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c857856-5eee-4945-a765-fcfff0cc275a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:26.522327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c857856-5eee-4945-a765-fcfff0cc275a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:26.523798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c857856-5eee-4945-a765-fcfff0cc275a service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:26.536039 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1154/2293] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:36.096223 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=63 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:36.531006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=65,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:41.980903 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:41.982272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:41.996110 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5e003-e4b5-40a9-b7b9-59913d8c2f0d service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:42.001706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20733-d0d2-44da-abf0-ab162a60df8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:42.002358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20733-d0d2-44da-abf0-ab162a60df8c service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:42.002639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20733-d0d2-44da-abf0-ab162a60df8c service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:42.002917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20733-d0d2-44da-abf0-ab162a60df8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:42.004669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c1f20733-d0d2-44da-abf0-ab162a60df8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:42.064615 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f20733-d0d2-44da-abf0-ab162a60df8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:42.066356 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f20733-d0d2-44da-abf0-ab162a60df8c service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:42.076572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1140/2294] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:52.071374 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=28 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:18:52.336252 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c857856-5eee-4945-a765-fcfff0cc275a service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:52.347956 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c857856-5eee-4945-a765-fcfff0cc275a service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:52.353675 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:52.354313 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:52.354600 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:52.355451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:52.357379 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:52.415579 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:52.417159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:52.426882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1155/2295] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:18:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:18:56.255314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2366-b4ca-4a9f-a63d-836a811f2913 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:56.255786 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2366-b4ca-4a9f-a63d-836a811f2913 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:56.255887 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2366-b4ca-4a9f-a63d-836a811f2913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:56.273544 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cf4c2366-b4ca-4a9f-a63d-836a811f2913 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:18:56.274790 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf4c2366-b4ca-4a9f-a63d-836a811f2913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:56.333812 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1141/2296] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:18:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:18:56.384699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:18:56.386774 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:18:56.455830 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae61072-897e-44b7-94b8-cd7bd4088d76 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:18:56.460742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae7b2-f986-4c6d-95ee-be9db9f1e20a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:18:56.461385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae7b2-f986-4c6d-95ee-be9db9f1e20a service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:18:56.461700 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae7b2-f986-4c6d-95ee-be9db9f1e20a service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:18:56.461981 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae7b2-f986-4c6d-95ee-be9db9f1e20a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:18:56.470754 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae7b2-f986-4c6d-95ee-be9db9f1e20a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:18:56.472327 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae7b2-f986-4c6d-95ee-be9db9f1e20a service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:18:56.481238 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1156/2297] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:18:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:19:06.327193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=25 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:19:06.477100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=60 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:19:06.798659 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c2366-b4ca-4a9f-a63d-836a811f2913 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:06.808086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c2366-b4ca-4a9f-a63d-836a811f2913 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:06.811825 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326917c9-34db-4a5c-ac3d-6702c79f709c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:06.812471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326917c9-34db-4a5c-ac3d-6702c79f709c service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:06.812752 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326917c9-34db-4a5c-ac3d-6702c79f709c service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:06.813028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326917c9-34db-4a5c-ac3d-6702c79f709c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:06.814823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-326917c9-34db-4a5c-ac3d-6702c79f709c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:06.824975 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326917c9-34db-4a5c-ac3d-6702c79f709c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:06.826707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326917c9-34db-4a5c-ac3d-6702c79f709c service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:06.837277 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1142/2298] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:19:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:19:11.282322 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae7b2-f986-4c6d-95ee-be9db9f1e20a service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:11.299096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae7b2-f986-4c6d-95ee-be9db9f1e20a service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:11.304490 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd264b-0287-4cf5-b633-e739c70394b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:11.305454 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd264b-0287-4cf5-b633-e739c70394b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.305930 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd264b-0287-4cf5-b633-e739c70394b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.306345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd264b-0287-4cf5-b633-e739c70394b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.309580 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44fd264b-0287-4cf5-b633-e739c70394b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:11.324520 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd264b-0287-4cf5-b633-e739c70394b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:11.326867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd264b-0287-4cf5-b633-e739c70394b7 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:11.338765 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1157/2299] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:19:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:19:11.449607 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf173-8992-490d-ad15-ed306bc26ede None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.450210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf173-8992-490d-ad15-ed306bc26ede None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.450210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf173-8992-490d-ad15-ed306bc26ede None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.451610 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1143/2300] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:19:11.458489 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1158e-af7b-4258-9c3c-b32c45f3dcc1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.458784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1158e-af7b-4258-9c3c-b32c45f3dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.459208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1158e-af7b-4258-9c3c-b32c45f3dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.505401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-79b1158e-af7b-4258-9c3c-b32c45f3dcc1 None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:19:11.506664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-79b1158e-af7b-4258-9c3c-b32c45f3dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:11.516886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1158/2301] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:19:11.529575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaf173-8992-490d-ad15-ed306bc26ede None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:11.541814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaf173-8992-490d-ad15-ed306bc26ede None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:11.553591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700adc6-5fe2-44fe-b1de-8f164baea266 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ac2738bf434afabe3d227dc5e52650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:11.554378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700adc6-5fe2-44fe-b1de-8f164baea266 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.554723 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700adc6-5fe2-44fe-b1de-8f164baea266 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.555070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700adc6-5fe2-44fe-b1de-8f164baea266 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.566707 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700adc6-5fe2-44fe-b1de-8f164baea266 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:11.568264 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700adc6-5fe2-44fe-b1de-8f164baea266 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:11.580664 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1144/2302] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:19:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:19:11.668699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee92a5-f918-4ee9-976a-9dfc3b7ffc19 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.669014 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee92a5-f918-4ee9-976a-9dfc3b7ffc19 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.669258 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee92a5-f918-4ee9-976a-9dfc3b7ffc19 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.672950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1159/2303] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:19:11.679305 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691a5de-db7f-4930-9c9d-25c541098a49 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.679591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691a5de-db7f-4930-9c9d-25c541098a49 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.679873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691a5de-db7f-4930-9c9d-25c541098a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.701289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7691a5de-db7f-4930-9c9d-25c541098a49 None None] MFA Rules not processed for user `08b3093a7415419cbb6d50701b09b7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:19:11.702567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7691a5de-db7f-4930-9c9d-25c541098a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:11.710129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1145/2304] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:19:11.724460 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee92a5-f918-4ee9-976a-9dfc3b7ffc19 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:11.727007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-63ee92a5-f918-4ee9-976a-9dfc3b7ffc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:11.741802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee92a5-f918-4ee9-976a-9dfc3b7ffc19 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:11.746289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783421c-3e3d-4846-9dfe-0962c1ec5a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:11.746809 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783421c-3e3d-4846-9dfe-0962c1ec5a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.747072 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783421c-3e3d-4846-9dfe-0962c1ec5a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.747351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783421c-3e3d-4846-9dfe-0962c1ec5a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.755387 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783421c-3e3d-4846-9dfe-0962c1ec5a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:11.757086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783421c-3e3d-4846-9dfe-0962c1ec5a9d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:11.766657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1160/2305] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:19:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:19:11.851507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deaf45-33a3-4306-8e2e-315cf88096f2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.851793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deaf45-33a3-4306-8e2e-315cf88096f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.852076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deaf45-33a3-4306-8e2e-315cf88096f2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.853503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1146/2306] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:19:11.860318 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ae68-e659-4f83-a556-42c5f7ddf0d3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.860610 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ae68-e659-4f83-a556-42c5f7ddf0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.860893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ae68-e659-4f83-a556-42c5f7ddf0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.882987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f623ae68-e659-4f83-a556-42c5f7ddf0d3 None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:19:11.884200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f623ae68-e659-4f83-a556-42c5f7ddf0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:11.895181 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1161/2307] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:19:11.906492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deaf45-33a3-4306-8e2e-315cf88096f2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:11.919072 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deaf45-33a3-4306-8e2e-315cf88096f2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:11.922818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb460c7d-2aa9-4b5d-9714-3ce7297d18cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:11.923477 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb460c7d-2aa9-4b5d-9714-3ce7297d18cb service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:11.923760 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb460c7d-2aa9-4b5d-9714-3ce7297d18cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:11.924039 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb460c7d-2aa9-4b5d-9714-3ce7297d18cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:11.936712 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb460c7d-2aa9-4b5d-9714-3ce7297d18cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:11.937675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb460c7d-2aa9-4b5d-9714-3ce7297d18cb service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:11.949710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1147/2308] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:19:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:19:12.020422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ae68-e659-4f83-a556-42c5f7ddf0d3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:12.023796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f623ae68-e659-4f83-a556-42c5f7ddf0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:12.095973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ae68-e659-4f83-a556-42c5f7ddf0d3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:12.106553 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aebc93-95b8-4d84-95ed-ec2aea52278b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:12.107223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aebc93-95b8-4d84-95ed-ec2aea52278b service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:12.107509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aebc93-95b8-4d84-95ed-ec2aea52278b service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:12.107789 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aebc93-95b8-4d84-95ed-ec2aea52278b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:12.109726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-76aebc93-95b8-4d84-95ed-ec2aea52278b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:12.122595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aebc93-95b8-4d84-95ed-ec2aea52278b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:12.124226 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aebc93-95b8-4d84-95ed-ec2aea52278b service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:12.134694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1162/2309] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:19:14.993420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412833a-51ed-4856-9487-f580b19b50cb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:14.993954 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412833a-51ed-4856-9487-f580b19b50cb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:14.994195 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412833a-51ed-4856-9487-f580b19b50cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:15.015147 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c412833a-51ed-4856-9487-f580b19b50cb None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:19:15.016376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c412833a-51ed-4856-9487-f580b19b50cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:15.024433 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1148/2310] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:19:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:19:15.037401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aebc93-95b8-4d84-95ed-ec2aea52278b service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:15.050907 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aebc93-95b8-4d84-95ed-ec2aea52278b service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:15.056202 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15971e57-6a4e-4edf-9eb4-d4bfc711bd17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:15.056843 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15971e57-6a4e-4edf-9eb4-d4bfc711bd17 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:15.057126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15971e57-6a4e-4edf-9eb4-d4bfc711bd17 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:15.057399 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15971e57-6a4e-4edf-9eb4-d4bfc711bd17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:15.068464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15971e57-6a4e-4edf-9eb4-d4bfc711bd17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:15.070201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15971e57-6a4e-4edf-9eb4-d4bfc711bd17 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:15.080609 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1163/2311] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:19:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:19:25.009503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=24 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:19:25.076572 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=62 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:19:25.468633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412833a-51ed-4856-9487-f580b19b50cb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:25.470310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c412833a-51ed-4856-9487-f580b19b50cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:25.489146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412833a-51ed-4856-9487-f580b19b50cb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:25.496384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b757d3-04f7-476d-97f8-b2f9a82f14fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:25.497083 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b757d3-04f7-476d-97f8-b2f9a82f14fe service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:25.497463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b757d3-04f7-476d-97f8-b2f9a82f14fe service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:25.497832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b757d3-04f7-476d-97f8-b2f9a82f14fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:25.499704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e9b757d3-04f7-476d-97f8-b2f9a82f14fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:25.563662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b757d3-04f7-476d-97f8-b2f9a82f14fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:25.565357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b757d3-04f7-476d-97f8-b2f9a82f14fe service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:25.576143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1149/2312] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:19:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:19:35.571112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=28 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:19:43.845963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15971e57-6a4e-4edf-9eb4-d4bfc711bd17 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:43.861082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15971e57-6a4e-4edf-9eb4-d4bfc711bd17 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:43.867215 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bb72a-81c4-4281-9162-eca6001929cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:43.867908 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bb72a-81c4-4281-9162-eca6001929cd service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:43.868247 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bb72a-81c4-4281-9162-eca6001929cd service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:43.868663 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bb72a-81c4-4281-9162-eca6001929cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:43.871498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-740bb72a-81c4-4281-9162-eca6001929cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:43.885778 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bb72a-81c4-4281-9162-eca6001929cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:43.887477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bb72a-81c4-4281-9162-eca6001929cd service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:43.901137 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1164/2313] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:19:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:19:46.775244 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6cc8-6e06-4f2d-8313-6ed07e7c6ac9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:46.775719 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6cc8-6e06-4f2d-8313-6ed07e7c6ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:46.776014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6cc8-6e06-4f2d-8313-6ed07e7c6ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:46.794282 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-082b6cc8-6e06-4f2d-8313-6ed07e7c6ac9 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:19:46.795762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-082b6cc8-6e06-4f2d-8313-6ed07e7c6ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:46.804151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1150/2314] 10.222.0.90 () {58 vars in 967 bytes} [Tue Jun 21 15:19:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:19:46.818980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bb72a-81c4-4281-9162-eca6001929cd service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:19:46.832340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bb72a-81c4-4281-9162-eca6001929cd service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:19:46.837464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758e908-0344-42f8-84ba-815b7aa28d1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:19:46.838770 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758e908-0344-42f8-84ba-815b7aa28d1d service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:46.839067 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758e908-0344-42f8-84ba-815b7aa28d1d service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:46.839355 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758e908-0344-42f8-84ba-815b7aa28d1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:46.848824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758e908-0344-42f8-84ba-815b7aa28d1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:19:46.850411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758e908-0344-42f8-84ba-815b7aa28d1d service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:19:46.859927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1165/2315] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:19:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:19:56.789044 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:19:56.856498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=12 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:19:59.143734 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09400417-9b51-439b-b52a-fbef5143f4ac None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:19:59.144559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09400417-9b51-439b-b52a-fbef5143f4ac None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:19:59.144559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09400417-9b51-439b-b52a-fbef5143f4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:19:59.163023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-09400417-9b51-439b-b52a-fbef5143f4ac None None] MFA Rules not processed for user `ee7a49315d634014bc8e89b33c6355d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:19:59.164279 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-09400417-9b51-439b-b52a-fbef5143f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:19:59.171990 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1151/2316] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:19:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:20:05.594291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758e908-0344-42f8-84ba-815b7aa28d1d service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:20:05.608428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758e908-0344-42f8-84ba-815b7aa28d1d service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:20:05.614900 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14e727-acda-49e6-8e4b-e28d3dfdd0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:20:05.615883 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14e727-acda-49e6-8e4b-e28d3dfdd0f4 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:20:05.616394 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14e727-acda-49e6-8e4b-e28d3dfdd0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:20:05.616691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14e727-acda-49e6-8e4b-e28d3dfdd0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:20:05.618578 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f14e727-acda-49e6-8e4b-e28d3dfdd0f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:20:05.632169 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14e727-acda-49e6-8e4b-e28d3dfdd0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:20:05.633789 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14e727-acda-49e6-8e4b-e28d3dfdd0f4 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:20:05.645092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1166/2317] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:20:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:20:09.158061 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:20:15.640419 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:20:35.292886 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09400417-9b51-439b-b52a-fbef5143f4ac None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:20:35.305426 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09400417-9b51-439b-b52a-fbef5143f4ac None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:20:35.311149 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ea40-3392-4315-bd25-6493403c364d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:20:35.311791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ea40-3392-4315-bd25-6493403c364d service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:20:35.312079 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ea40-3392-4315-bd25-6493403c364d service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:20:35.312357 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ea40-3392-4315-bd25-6493403c364d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:20:35.314130 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4e83ea40-3392-4315-bd25-6493403c364d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:20:35.325314 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83ea40-3392-4315-bd25-6493403c364d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:20:35.327006 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83ea40-3392-4315-bd25-6493403c364d service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:20:35.335893 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1152/2318] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:20:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:20:38.883866 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14e727-acda-49e6-8e4b-e28d3dfdd0f4 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:20:38.896306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14e727-acda-49e6-8e4b-e28d3dfdd0f4 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:20:38.903762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e992cc9-b45f-4d4b-a13f-9f33685fb9e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:20:38.904998 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e992cc9-b45f-4d4b-a13f-9f33685fb9e2 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:20:38.905526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e992cc9-b45f-4d4b-a13f-9f33685fb9e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:20:38.905990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e992cc9-b45f-4d4b-a13f-9f33685fb9e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:20:38.908397 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5e992cc9-b45f-4d4b-a13f-9f33685fb9e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:20:38.929346 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e992cc9-b45f-4d4b-a13f-9f33685fb9e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:20:38.932208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e992cc9-b45f-4d4b-a13f-9f33685fb9e2 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:20:38.949147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1167/2319] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:20:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:20:45.331841 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:20:47.947996 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c75b3-ecf4-4b7b-b3cb-0da0bda2b5bb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:20:47.948683 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c75b3-ecf4-4b7b-b3cb-0da0bda2b5bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:20:47.948683 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c75b3-ecf4-4b7b-b3cb-0da0bda2b5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:20:47.967496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1d3c75b3-ecf4-4b7b-b3cb-0da0bda2b5bb None None] MFA Rules not processed for user `d56ce8a772d7417eb4224f3e13cc0759`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:20:47.968726 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1d3c75b3-ecf4-4b7b-b3cb-0da0bda2b5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:20:47.975879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1153/2320] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:20:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:20:48.322431 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e992cc9-b45f-4d4b-a13f-9f33685fb9e2 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:20:48.331990 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e992cc9-b45f-4d4b-a13f-9f33685fb9e2 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:20:48.335666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf672c-3c59-4eb6-85d7-ec2d952b8511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:20:48.336340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf672c-3c59-4eb6-85d7-ec2d952b8511 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:20:48.337266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf672c-3c59-4eb6-85d7-ec2d952b8511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:20:48.337604 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf672c-3c59-4eb6-85d7-ec2d952b8511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:20:48.339628 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dedf672c-3c59-4eb6-85d7-ec2d952b8511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:20:48.350538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf672c-3c59-4eb6-85d7-ec2d952b8511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:20:48.351982 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf672c-3c59-4eb6-85d7-ec2d952b8511 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:20:48.361405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1168/2321] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:20:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:20:57.962275 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:20:58.357804 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=12 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:03.730321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440badeb-0d10-4525-8f06-bf5e6662c05b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:03.730321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440badeb-0d10-4525-8f06-bf5e6662c05b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:03.730321 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440badeb-0d10-4525-8f06-bf5e6662c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:03.754772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-440badeb-0d10-4525-8f06-bf5e6662c05b None None] MFA Rules not processed for user `a46beb5fe7d145d5aa0a821c471f2dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:03.756542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-440badeb-0d10-4525-8f06-bf5e6662c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:03.838550 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1154/2322] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:08.062763 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5454e-0e84-4d38-927f-b02c0168135d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:08.064325 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5454e-0e84-4d38-927f-b02c0168135d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:08.064836 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5454e-0e84-4d38-927f-b02c0168135d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:08.095639 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-19f5454e-0e84-4d38-927f-b02c0168135d None None] MFA Rules not processed for user `873694a34f1f40128a9c2eeaaa8424cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:08.096562 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-19f5454e-0e84-4d38-927f-b02c0168135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:08.105194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1169/2323] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:13.825382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=25 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:18.088678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:36.297440 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440badeb-0d10-4525-8f06-bf5e6662c05b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:36.299398 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-440badeb-0d10-4525-8f06-bf5e6662c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:36.315035 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440badeb-0d10-4525-8f06-bf5e6662c05b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:36.320143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d84a9-e7d3-4c31-9774-13d04ce8c1e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:36.320890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d84a9-e7d3-4c31-9774-13d04ce8c1e7 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:36.321189 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d84a9-e7d3-4c31-9774-13d04ce8c1e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:36.321495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d84a9-e7d3-4c31-9774-13d04ce8c1e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:36.323352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe3d84a9-e7d3-4c31-9774-13d04ce8c1e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:36.336889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d84a9-e7d3-4c31-9774-13d04ce8c1e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:36.338539 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d84a9-e7d3-4c31-9774-13d04ce8c1e7 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:36.349611 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1155/2324] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:21:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:21:40.918084 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5454e-0e84-4d38-927f-b02c0168135d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:40.927738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5454e-0e84-4d38-927f-b02c0168135d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:40.931691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:40.932336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:40.932622 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:40.932894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:40.935471 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:41.004037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:41.005486 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:41.015991 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1170/2325] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:21:44.382865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d84a9-e7d3-4c31-9774-13d04ce8c1e7 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:44.398423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d84a9-e7d3-4c31-9774-13d04ce8c1e7 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:44.406080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f119a6a-5e39-4d05-b4d0-97f6dc6b864d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:44.406787 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f119a6a-5e39-4d05-b4d0-97f6dc6b864d service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:44.407134 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f119a6a-5e39-4d05-b4d0-97f6dc6b864d service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:44.407478 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f119a6a-5e39-4d05-b4d0-97f6dc6b864d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:44.410447 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8f119a6a-5e39-4d05-b4d0-97f6dc6b864d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:44.435788 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f119a6a-5e39-4d05-b4d0-97f6dc6b864d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:44.437559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f119a6a-5e39-4d05-b4d0-97f6dc6b864d service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:44.459793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1156/2326] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:21:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:21:44.484494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:44.486477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:44.507669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd9b72-1ef7-4791-becb-f4fdc11f55db service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:44.512941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:44.513882 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:44.514170 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:44.514445 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] PATH_INFO: `/v3/users/ee7a49315d634014bc8e89b33c6355d4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:44.515661 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7a49315d634014bc8e89b33c6355d4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:44.517692 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:44.568311 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7a49315d634014bc8e89b33c6355d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.580977 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7a49315d634014bc8e89b33c6355d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.588810 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7a49315d634014bc8e89b33c6355d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.589597 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7a49315d634014bc8e89b33c6355d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.590342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b21fc06c-d139-47f8-959a-6c61e649495c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7a49315d634014bc8e89b33c6355d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.604371 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1171/2327] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:21:44 2022] DELETE /identity/v3/users/ee7a49315d634014bc8e89b33c6355d4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:44.800438 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f119a6a-5e39-4d05-b4d0-97f6dc6b864d service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:44.813822 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f119a6a-5e39-4d05-b4d0-97f6dc6b864d service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:44.880476 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:44.881334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:44.881649 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:44.881978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] PATH_INFO: `/v3/projects/1d7389922c374cd4bc6e9505b6b4ad3e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:44.883312 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7389922c374cd4bc6e9505b6b4ad3e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:44.885255 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:44.949715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7389922c374cd4bc6e9505b6b4ad3e', 'request_id': 'req-b25468cc-b191-4430-89ce-1302b70bf6ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.961170 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7389922c374cd4bc6e9505b6b4ad3e', 'request_id': 'req-b25468cc-b191-4430-89ce-1302b70bf6ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.967918 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7389922c374cd4bc6e9505b6b4ad3e', 'request_id': 'req-b25468cc-b191-4430-89ce-1302b70bf6ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.980637 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] The token cache is being invalidate because project 1d7389922c374cd4bc6e9505b6b4ad3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:21:44.980929 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.981646 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b25468cc-b191-4430-89ce-1302b70bf6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:44.983210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1157/2328] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:21:44 2022] DELETE /identity/v3/projects/1d7389922c374cd4bc6e9505b6b4ad3e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:44.990145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a8d4b-697d-4652-8da5-d1fdbf24edd5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:44.990433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a8d4b-697d-4652-8da5-d1fdbf24edd5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:44.990713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a8d4b-697d-4652-8da5-d1fdbf24edd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.009632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ff8a8d4b-697d-4652-8da5-d1fdbf24edd5 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:45.010869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff8a8d4b-697d-4652-8da5-d1fdbf24edd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:45.074873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1172/2329] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:45.082756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17860722-b46a-4130-b962-96c3a7eb0da2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:45.082976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17860722-b46a-4130-b962-96c3a7eb0da2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:45.083251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17860722-b46a-4130-b962-96c3a7eb0da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.102765 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-17860722-b46a-4130-b962-96c3a7eb0da2 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:45.103985 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-17860722-b46a-4130-b962-96c3a7eb0da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:45.112151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1158/2330] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:45.117635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a8d4b-697d-4652-8da5-d1fdbf24edd5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:45.127709 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a8d4b-697d-4652-8da5-d1fdbf24edd5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:45.132667 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960909-1fbc-4cb2-9e05-9d21933994dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:45.133336 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960909-1fbc-4cb2-9e05-9d21933994dc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:45.133649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960909-1fbc-4cb2-9e05-9d21933994dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:45.133931 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960909-1fbc-4cb2-9e05-9d21933994dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.134670 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9960909-1fbc-4cb2-9e05-9d21933994dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:21:45.134980 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9960909-1fbc-4cb2-9e05-9d21933994dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:45.136588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9960909-1fbc-4cb2-9e05-9d21933994dc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:45.138556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:45.152632 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1173/2331] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:21:45.157205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17860722-b46a-4130-b962-96c3a7eb0da2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:45.167239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17860722-b46a-4130-b962-96c3a7eb0da2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:45.173165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841438-e1fd-4e71-8205-1118830b5b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:45.173878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841438-e1fd-4e71-8205-1118830b5b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:45.174168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841438-e1fd-4e71-8205-1118830b5b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:45.174445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841438-e1fd-4e71-8205-1118830b5b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.175162 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841438-e1fd-4e71-8205-1118830b5b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:45.177138 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841438-e1fd-4e71-8205-1118830b5b9a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:45.216704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1159/2332] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:21:45 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:21:45.221000 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960909-1fbc-4cb2-9e05-9d21933994dc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:45.233025 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960909-1fbc-4cb2-9e05-9d21933994dc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:45.296813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f8b24-7111-4f24-b648-016fa03a85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:45.297529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f8b24-7111-4f24-b648-016fa03a85f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:45.297822 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f8b24-7111-4f24-b648-016fa03a85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:45.298102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f8b24-7111-4f24-b648-016fa03a85f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.298798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f8b24-7111-4f24-b648-016fa03a85f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:45.300721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f8b24-7111-4f24-b648-016fa03a85f7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:45.325224 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1174/2333] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:21:45 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:21:45.326420 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841438-e1fd-4e71-8205-1118830b5b9a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:45.347459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841438-e1fd-4e71-8205-1118830b5b9a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:45.347459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3530560-4f23-4e0b-8439-0e35242b8396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:45.347459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3530560-4f23-4e0b-8439-0e35242b8396 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:45.347459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3530560-4f23-4e0b-8439-0e35242b8396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:45.347979 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3530560-4f23-4e0b-8439-0e35242b8396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.347979 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3530560-4f23-4e0b-8439-0e35242b8396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:45.347979 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3530560-4f23-4e0b-8439-0e35242b8396 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:45.358957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1160/2334] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:21:45.363797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f8b24-7111-4f24-b648-016fa03a85f7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:45.374608 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f8b24-7111-4f24-b648-016fa03a85f7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:45.379297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd31b07-b78b-4546-8bae-b96c3baa3ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:45.379965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31b07-b78b-4546-8bae-b96c3baa3ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:45.380250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31b07-b78b-4546-8bae-b96c3baa3ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:45.380534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31b07-b78b-4546-8bae-b96c3baa3ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.381301 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd31b07-b78b-4546-8bae-b96c3baa3ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:45.383075 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd31b07-b78b-4546-8bae-b96c3baa3ea9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:45.394107 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1175/2335] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:21:45.398658 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3530560-4f23-4e0b-8439-0e35242b8396 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:45.409067 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3530560-4f23-4e0b-8439-0e35242b8396 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:45.414656 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd249e81-2da9-4b7f-9161-e9e68d3a907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:45.415331 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd249e81-2da9-4b7f-9161-e9e68d3a907e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:45.415614 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd249e81-2da9-4b7f-9161-e9e68d3a907e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:45.415894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd249e81-2da9-4b7f-9161-e9e68d3a907e admin admin] PATH_INFO: `/v3/projects/66e6e47463894f7ba31b648d4396dc86/users/b52dcf7261ed46b983af44623e74a10a/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.428810 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:45.436488 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd249e81-2da9-4b7f-9161-e9e68d3a907e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e6e47463894f7ba31b648d4396dc86, user_id=b52dcf7261ed46b983af44623e74a10a, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:45.439661 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd249e81-2da9-4b7f-9161-e9e68d3a907e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:45.456099 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1161/2336] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:21:45 2022] PUT /identity/v3/projects/66e6e47463894f7ba31b648d4396dc86/users/b52dcf7261ed46b983af44623e74a10a/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:45.467081 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c6dba-7a45-4515-89bb-a104521fc369 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:45.467569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c6dba-7a45-4515-89bb-a104521fc369 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:45.467861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c6dba-7a45-4515-89bb-a104521fc369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.497547 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bc2c6dba-7a45-4515-89bb-a104521fc369 None None] MFA Rules not processed for user `b52dcf7261ed46b983af44623e74a10a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:45.498777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bc2c6dba-7a45-4515-89bb-a104521fc369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:45.567526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1176/2337] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:45.579992 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd249e81-2da9-4b7f-9161-e9e68d3a907e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:45.581915 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dd249e81-2da9-4b7f-9161-e9e68d3a907e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:45.664027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd249e81-2da9-4b7f-9161-e9e68d3a907e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:45.669871 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40d09-e693-4ae9-ac05-24e0b46d1796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:45.670520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40d09-e693-4ae9-ac05-24e0b46d1796 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:45.670801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40d09-e693-4ae9-ac05-24e0b46d1796 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:45.671076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40d09-e693-4ae9-ac05-24e0b46d1796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:45.679586 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40d09-e693-4ae9-ac05-24e0b46d1796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:45.681167 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40d09-e693-4ae9-ac05-24e0b46d1796 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:45.690482 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1162/2338] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:21:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:21:55.145111 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c6dba-7a45-4515-89bb-a104521fc369 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:55.212587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c6dba-7a45-4515-89bb-a104521fc369 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:55.217274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:55.218235 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:55.218526 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:55.218811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] PATH_INFO: `/v3/users/b52dcf7261ed46b983af44623e74a10a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:55.220034 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52dcf7261ed46b983af44623e74a10a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:55.221999 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:55.224633 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:55.274896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52dcf7261ed46b983af44623e74a10a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.287386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52dcf7261ed46b983af44623e74a10a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.294596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52dcf7261ed46b983af44623e74a10a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.295253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52dcf7261ed46b983af44623e74a10a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.295856 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52dcf7261ed46b983af44623e74a10a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.310046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1177/2339] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:21:55 2022] DELETE /identity/v3/users/b52dcf7261ed46b983af44623e74a10a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:55.316103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095a856-c884-4cf8-9e92-913cf6404175 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:55.316647 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095a856-c884-4cf8-9e92-913cf6404175 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:55.316785 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095a856-c884-4cf8-9e92-913cf6404175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:55.335961 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4095a856-c884-4cf8-9e92-913cf6404175 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:55.337225 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4095a856-c884-4cf8-9e92-913cf6404175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:55.399332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1163/2340] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:21:55.409291 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:55.410874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:55.471865 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d3e64-2588-4e7c-876c-8c3bf0c01961 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:55.475569 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a70812-8fcc-4f2d-92bc-688aeea81175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:55.476764 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a70812-8fcc-4f2d-92bc-688aeea81175 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:55.477042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a70812-8fcc-4f2d-92bc-688aeea81175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:55.477317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a70812-8fcc-4f2d-92bc-688aeea81175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:55.487079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a70812-8fcc-4f2d-92bc-688aeea81175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:55.488519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a70812-8fcc-4f2d-92bc-688aeea81175 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:55.500004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1178/2341] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:21:55.802150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095a856-c884-4cf8-9e92-913cf6404175 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:55.803459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4095a856-c884-4cf8-9e92-913cf6404175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:55.817299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095a856-c884-4cf8-9e92-913cf6404175 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:55.823530 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:55.824494 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:55.824847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:55.825192 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] PATH_INFO: `/v3/projects/66e6e47463894f7ba31b648d4396dc86` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:55.826584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e6e47463894f7ba31b648d4396dc86)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:55.830097 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:55.888290 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e6e47463894f7ba31b648d4396dc86', 'request_id': 'req-733af89a-4fa3-4170-8e93-97091b67ae69'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.901330 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e6e47463894f7ba31b648d4396dc86', 'request_id': 'req-733af89a-4fa3-4170-8e93-97091b67ae69'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.910546 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e6e47463894f7ba31b648d4396dc86', 'request_id': 'req-733af89a-4fa3-4170-8e93-97091b67ae69'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.923307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:55.927424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] The token cache is being invalidate because project 66e6e47463894f7ba31b648d4396dc86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:21:55.927714 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.928390 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-733af89a-4fa3-4170-8e93-97091b67ae69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:55.930065 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1164/2342] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:21:55 2022] DELETE /identity/v3/projects/66e6e47463894f7ba31b648d4396dc86 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:55.935283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa03ce5-af9f-4cda-9a74-a28d0edf2018 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:55.935556 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa03ce5-af9f-4cda-9a74-a28d0edf2018 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:55.935831 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa03ce5-af9f-4cda-9a74-a28d0edf2018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:55.956224 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9fa03ce5-af9f-4cda-9a74-a28d0edf2018 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:55.957727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9fa03ce5-af9f-4cda-9a74-a28d0edf2018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:56.024317 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1179/2343] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:56.032638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66dc0b-2228-4786-ae55-73cca340c890 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.032932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66dc0b-2228-4786-ae55-73cca340c890 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.033216 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66dc0b-2228-4786-ae55-73cca340c890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.053215 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dd66dc0b-2228-4786-ae55-73cca340c890 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:56.055027 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dd66dc0b-2228-4786-ae55-73cca340c890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:56.063211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1165/2344] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:56.067473 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa03ce5-af9f-4cda-9a74-a28d0edf2018 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:56.077920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa03ce5-af9f-4cda-9a74-a28d0edf2018 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:56.082586 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ecf6e-c70e-46ce-bab1-af4800298f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:56.083246 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ecf6e-c70e-46ce-bab1-af4800298f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.083534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ecf6e-c70e-46ce-bab1-af4800298f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.083814 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ecf6e-c70e-46ce-bab1-af4800298f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.084544 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ecf6e-c70e-46ce-bab1-af4800298f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:21:56.084852 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ecf6e-c70e-46ce-bab1-af4800298f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:56.087177 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ecf6e-c70e-46ce-bab1-af4800298f86 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:56.099376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1180/2345] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:21:56.104499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66dc0b-2228-4786-ae55-73cca340c890 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:56.114042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66dc0b-2228-4786-ae55-73cca340c890 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:56.119502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f591e-a67e-40dd-81a8-58b218421e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:56.120184 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f591e-a67e-40dd-81a8-58b218421e6e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.120453 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f591e-a67e-40dd-81a8-58b218421e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.120738 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f591e-a67e-40dd-81a8-58b218421e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.121444 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f591e-a67e-40dd-81a8-58b218421e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:56.123406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f591e-a67e-40dd-81a8-58b218421e6e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:56.152914 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1166/2346] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:21:56 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:21:56.157376 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ecf6e-c70e-46ce-bab1-af4800298f86 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:56.167785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ecf6e-c70e-46ce-bab1-af4800298f86 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:56.176241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:56.233892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e819d-9ad9-4d3c-9c0b-968d4ac7ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:56.234589 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e819d-9ad9-4d3c-9c0b-968d4ac7ef9c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.234871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e819d-9ad9-4d3c-9c0b-968d4ac7ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.235145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e819d-9ad9-4d3c-9c0b-968d4ac7ef9c admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.235855 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e819d-9ad9-4d3c-9c0b-968d4ac7ef9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:56.238030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e819d-9ad9-4d3c-9c0b-968d4ac7ef9c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:56.264174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1181/2347] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:21:56 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:21:56.268935 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f591e-a67e-40dd-81a8-58b218421e6e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:56.281110 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f591e-a67e-40dd-81a8-58b218421e6e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:56.285821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e843263-42a0-48ee-ba6f-2dc35c28f04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:56.286466 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e843263-42a0-48ee-ba6f-2dc35c28f04a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.286747 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e843263-42a0-48ee-ba6f-2dc35c28f04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.287023 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e843263-42a0-48ee-ba6f-2dc35c28f04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.287749 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e843263-42a0-48ee-ba6f-2dc35c28f04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:56.289444 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e843263-42a0-48ee-ba6f-2dc35c28f04a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:56.300473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1167/2348] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:21:56.304691 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e819d-9ad9-4d3c-9c0b-968d4ac7ef9c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:56.314715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e819d-9ad9-4d3c-9c0b-968d4ac7ef9c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:56.319452 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b06bbe-ecf9-4be5-9cde-085cd7479931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:56.320695 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b06bbe-ecf9-4be5-9cde-085cd7479931 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.321030 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b06bbe-ecf9-4be5-9cde-085cd7479931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.321310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b06bbe-ecf9-4be5-9cde-085cd7479931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.322074 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b06bbe-ecf9-4be5-9cde-085cd7479931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:56.323682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b06bbe-ecf9-4be5-9cde-085cd7479931 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:56.334280 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1182/2349] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:21:56.339289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e843263-42a0-48ee-ba6f-2dc35c28f04a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:56.349999 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e843263-42a0-48ee-ba6f-2dc35c28f04a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:56.355358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce665cf-9377-4ccf-9a1c-8dd7aefb5bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:56.356270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce665cf-9377-4ccf-9a1c-8dd7aefb5bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.356567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce665cf-9377-4ccf-9a1c-8dd7aefb5bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.356831 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce665cf-9377-4ccf-9a1c-8dd7aefb5bb7 admin admin] PATH_INFO: `/v3/projects/15d35302187e4488b720de0f1b72fc73/users/50332130905d40388271ea038e39814a/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.372373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce665cf-9377-4ccf-9a1c-8dd7aefb5bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d35302187e4488b720de0f1b72fc73, user_id=50332130905d40388271ea038e39814a, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:56.375424 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce665cf-9377-4ccf-9a1c-8dd7aefb5bb7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:56.388802 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1168/2350] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:21:56 2022] PUT /identity/v3/projects/15d35302187e4488b720de0f1b72fc73/users/50332130905d40388271ea038e39814a/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:56.399827 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523637-10e3-4f60-9565-a5a0c069f2c9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.400180 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523637-10e3-4f60-9565-a5a0c069f2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.400555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523637-10e3-4f60-9565-a5a0c069f2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.428534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-96523637-10e3-4f60-9565-a5a0c069f2c9 None None] MFA Rules not processed for user `50332130905d40388271ea038e39814a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:56.430194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-96523637-10e3-4f60-9565-a5a0c069f2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:56.498913 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1183/2351] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:56.511763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce665cf-9377-4ccf-9a1c-8dd7aefb5bb7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:56.513520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4ce665cf-9377-4ccf-9a1c-8dd7aefb5bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:56.592554 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce665cf-9377-4ccf-9a1c-8dd7aefb5bb7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:56.598289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d59c67-87f9-4dc5-905c-33c965c86e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:56.598941 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d59c67-87f9-4dc5-905c-33c965c86e73 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.599228 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d59c67-87f9-4dc5-905c-33c965c86e73 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.599506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d59c67-87f9-4dc5-905c-33c965c86e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.608239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d59c67-87f9-4dc5-905c-33c965c86e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:56.609885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d59c67-87f9-4dc5-905c-33c965c86e73 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:56.619655 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1169/2352] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:21:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:21:56.836012 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96523637-10e3-4f60-9565-a5a0c069f2c9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:56.904013 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96523637-10e3-4f60-9565-a5a0c069f2c9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:56.908539 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:56.909407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:56.909740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:56.910017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] PATH_INFO: `/v3/users/50332130905d40388271ea038e39814a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:56.911220 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50332130905d40388271ea038e39814a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:56.913130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:56.937833 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:56.969229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50332130905d40388271ea038e39814a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:56.987045 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50332130905d40388271ea038e39814a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:56.995421 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50332130905d40388271ea038e39814a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:56.996156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50332130905d40388271ea038e39814a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:56.996773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50332130905d40388271ea038e39814a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:57.011497 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1184/2353] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:21:56 2022] DELETE /identity/v3/users/50332130905d40388271ea038e39814a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:57.016094 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244600e-65d5-45ea-9deb-106f838b409a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:57.016382 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244600e-65d5-45ea-9deb-106f838b409a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:57.016710 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244600e-65d5-45ea-9deb-106f838b409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:57.039230 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4244600e-65d5-45ea-9deb-106f838b409a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:57.040446 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4244600e-65d5-45ea-9deb-106f838b409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:57.105129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1170/2354] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:21:57.115240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:57.117299 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:57.180260 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14aadc-e138-492c-853f-eaad55815090 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:57.186158 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a12aef-f0de-4b05-9ae0-61e1a1f8705b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:57.187106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a12aef-f0de-4b05-9ae0-61e1a1f8705b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:57.187538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a12aef-f0de-4b05-9ae0-61e1a1f8705b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:57.187963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a12aef-f0de-4b05-9ae0-61e1a1f8705b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:57.200529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a12aef-f0de-4b05-9ae0-61e1a1f8705b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:57.202006 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a12aef-f0de-4b05-9ae0-61e1a1f8705b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:57.213306 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1185/2355] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:21:57.527613 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244600e-65d5-45ea-9deb-106f838b409a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:57.529572 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4244600e-65d5-45ea-9deb-106f838b409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:57.549884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244600e-65d5-45ea-9deb-106f838b409a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:57.559872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:57.561376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:57.561956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:57.562502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] PATH_INFO: `/v3/projects/15d35302187e4488b720de0f1b72fc73` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:57.564540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d35302187e4488b720de0f1b72fc73)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:57.567835 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:57.587070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:57.619695 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d35302187e4488b720de0f1b72fc73', 'request_id': 'req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:57.628387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d35302187e4488b720de0f1b72fc73', 'request_id': 'req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:57.634475 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d35302187e4488b720de0f1b72fc73', 'request_id': 'req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:57.646190 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] The token cache is being invalidate because project 15d35302187e4488b720de0f1b72fc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:21:57.646480 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:57.647145 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2de6fdec-dc6e-4b1a-9d45-9349d9ccffe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:57.648921 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1171/2356] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:21:57 2022] DELETE /identity/v3/projects/15d35302187e4488b720de0f1b72fc73 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:57.661641 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504848b-030a-4f38-98a6-6ee89062ad67 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:57.661937 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504848b-030a-4f38-98a6-6ee89062ad67 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:57.662221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504848b-030a-4f38-98a6-6ee89062ad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:57.682240 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e504848b-030a-4f38-98a6-6ee89062ad67 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:57.683461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e504848b-030a-4f38-98a6-6ee89062ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:57.745525 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1186/2357] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:57.753568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514914a-1c37-40bf-bcb7-12b524a51309 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:57.753860 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514914a-1c37-40bf-bcb7-12b524a51309 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:57.754143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514914a-1c37-40bf-bcb7-12b524a51309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:57.776428 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2514914a-1c37-40bf-bcb7-12b524a51309 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:57.777748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2514914a-1c37-40bf-bcb7-12b524a51309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:57.786121 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1172/2358] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:57.791522 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504848b-030a-4f38-98a6-6ee89062ad67 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:57.801669 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504848b-030a-4f38-98a6-6ee89062ad67 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:57.807138 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dec6eb-4b0e-4cb0-a664-ba8b5ec658d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:57.807811 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dec6eb-4b0e-4cb0-a664-ba8b5ec658d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:57.808088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dec6eb-4b0e-4cb0-a664-ba8b5ec658d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:57.808362 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dec6eb-4b0e-4cb0-a664-ba8b5ec658d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:57.809102 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dec6eb-4b0e-4cb0-a664-ba8b5ec658d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:21:57.809407 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dec6eb-4b0e-4cb0-a664-ba8b5ec658d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:57.811052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dec6eb-4b0e-4cb0-a664-ba8b5ec658d7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:57.823719 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1187/2359] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:21:57.828309 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514914a-1c37-40bf-bcb7-12b524a51309 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:57.837973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514914a-1c37-40bf-bcb7-12b524a51309 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:57.846173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2689c-c73d-4321-8c82-22ba74b69eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:57.846855 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2689c-c73d-4321-8c82-22ba74b69eef admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:57.847136 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2689c-c73d-4321-8c82-22ba74b69eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:57.847422 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2689c-c73d-4321-8c82-22ba74b69eef admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:57.848150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2689c-c73d-4321-8c82-22ba74b69eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:57.850098 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2689c-c73d-4321-8c82-22ba74b69eef admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:57.881064 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1173/2360] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:21:57 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:21:57.883204 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dec6eb-4b0e-4cb0-a664-ba8b5ec658d7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:57.894236 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dec6eb-4b0e-4cb0-a664-ba8b5ec658d7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:57.927879 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:57.963493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a2384-cd09-4a23-8cad-9e4c849f0916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:57.964165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a2384-cd09-4a23-8cad-9e4c849f0916 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:57.964448 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a2384-cd09-4a23-8cad-9e4c849f0916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:57.964718 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a2384-cd09-4a23-8cad-9e4c849f0916 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:57.965411 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a2384-cd09-4a23-8cad-9e4c849f0916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:57.967349 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a2384-cd09-4a23-8cad-9e4c849f0916 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:57.989758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1188/2361] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:21:57 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:21:57.994569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2689c-c73d-4321-8c82-22ba74b69eef admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:58.006299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2689c-c73d-4321-8c82-22ba74b69eef admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:58.011011 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f96007-8d2a-47d2-aec1-f1acf007a3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:58.011673 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96007-8d2a-47d2-aec1-f1acf007a3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:58.011984 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96007-8d2a-47d2-aec1-f1acf007a3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:58.012256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96007-8d2a-47d2-aec1-f1acf007a3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:58.012983 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f96007-8d2a-47d2-aec1-f1acf007a3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:58.014772 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f96007-8d2a-47d2-aec1-f1acf007a3d8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:58.026353 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1174/2362] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:21:58.031125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a2384-cd09-4a23-8cad-9e4c849f0916 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:58.042126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a2384-cd09-4a23-8cad-9e4c849f0916 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:58.047268 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6a188-fe60-492f-9356-92c24c056a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:58.047943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6a188-fe60-492f-9356-92c24c056a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:58.048231 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6a188-fe60-492f-9356-92c24c056a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:58.048541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6a188-fe60-492f-9356-92c24c056a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:58.049279 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6a188-fe60-492f-9356-92c24c056a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:58.050933 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6a188-fe60-492f-9356-92c24c056a20 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:58.061997 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1189/2363] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:21:58.066174 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f96007-8d2a-47d2-aec1-f1acf007a3d8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:58.076917 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f96007-8d2a-47d2-aec1-f1acf007a3d8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:58.081652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2301d33-a8dc-47b0-931b-3415121c4ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:58.082528 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301d33-a8dc-47b0-931b-3415121c4ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:58.082811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301d33-a8dc-47b0-931b-3415121c4ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:58.083088 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301d33-a8dc-47b0-931b-3415121c4ede admin admin] PATH_INFO: `/v3/projects/bc980922d9e748f9831c91b98e48827b/users/872f29cab1944e4489367732c65b3610/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:58.100269 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2301d33-a8dc-47b0-931b-3415121c4ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc980922d9e748f9831c91b98e48827b, user_id=872f29cab1944e4489367732c65b3610, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:58.103908 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2301d33-a8dc-47b0-931b-3415121c4ede admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:58.118101 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1175/2364] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:21:58 2022] PUT /identity/v3/projects/bc980922d9e748f9831c91b98e48827b/users/872f29cab1944e4489367732c65b3610/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:58.129743 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f233f-65b3-48fa-961b-a92fe781d03f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:58.130036 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f233f-65b3-48fa-961b-a92fe781d03f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:58.130315 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f233f-65b3-48fa-961b-a92fe781d03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:58.161303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ec6f233f-65b3-48fa-961b-a92fe781d03f None None] MFA Rules not processed for user `872f29cab1944e4489367732c65b3610`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:58.162863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ec6f233f-65b3-48fa-961b-a92fe781d03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:58.252076 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1190/2365] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:58.264487 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2301d33-a8dc-47b0-931b-3415121c4ede admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:58.266210 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c2301d33-a8dc-47b0-931b-3415121c4ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:58.328471 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2301d33-a8dc-47b0-931b-3415121c4ede admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:58.332168 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d5a24-a74a-4ef0-945c-69ced0063251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:58.332818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d5a24-a74a-4ef0-945c-69ced0063251 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:58.333102 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d5a24-a74a-4ef0-945c-69ced0063251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:58.333379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d5a24-a74a-4ef0-945c-69ced0063251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:58.342895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d5a24-a74a-4ef0-945c-69ced0063251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:58.344336 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d5a24-a74a-4ef0-945c-69ced0063251 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:58.354997 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1176/2366] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:21:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:21:58.375870 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f233f-65b3-48fa-961b-a92fe781d03f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:58.443206 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f233f-65b3-48fa-961b-a92fe781d03f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:58.448624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:58.449536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:58.449834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:58.450105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] PATH_INFO: `/v3/users/872f29cab1944e4489367732c65b3610` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:58.451345 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872f29cab1944e4489367732c65b3610)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:58.453283 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:58.510447 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:58.519645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872f29cab1944e4489367732c65b3610'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:58.534724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872f29cab1944e4489367732c65b3610'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:58.543085 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872f29cab1944e4489367732c65b3610'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:58.544179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872f29cab1944e4489367732c65b3610'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:58.544805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872f29cab1944e4489367732c65b3610'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:58.569665 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1191/2367] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:21:58 2022] DELETE /identity/v3/users/872f29cab1944e4489367732c65b3610 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:58.571696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad378cd-be58-4e33-896f-6b662943ba43 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:58.572490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad378cd-be58-4e33-896f-6b662943ba43 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:58.572490 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad378cd-be58-4e33-896f-6b662943ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:58.596010 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9ad378cd-be58-4e33-896f-6b662943ba43 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:58.597283 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9ad378cd-be58-4e33-896f-6b662943ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:58.647629 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:58.679053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1177/2368] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:58.695892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:58.698479 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:58.769664 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32c5e8-b47d-4a87-8cfa-6fbf1505d191 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:58.775113 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d16fb-d2ad-4fbf-96a1-4f879ef942da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:58.775923 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d16fb-d2ad-4fbf-96a1-4f879ef942da service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:58.776351 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d16fb-d2ad-4fbf-96a1-4f879ef942da service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:58.776607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d16fb-d2ad-4fbf-96a1-4f879ef942da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:58.793498 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d16fb-d2ad-4fbf-96a1-4f879ef942da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:58.796128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d16fb-d2ad-4fbf-96a1-4f879ef942da service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:58.808668 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1192/2369] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:21:59.141042 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad378cd-be58-4e33-896f-6b662943ba43 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:59.142495 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9ad378cd-be58-4e33-896f-6b662943ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:59.160799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad378cd-be58-4e33-896f-6b662943ba43 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:59.169687 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:59.170693 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.171173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.171459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] PATH_INFO: `/v3/projects/bc980922d9e748f9831c91b98e48827b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.173050 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc980922d9e748f9831c91b98e48827b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:59.177016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:59.233694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc980922d9e748f9831c91b98e48827b', 'request_id': 'req-daff9615-800b-4e77-83ca-ad349124e253'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:59.243034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc980922d9e748f9831c91b98e48827b', 'request_id': 'req-daff9615-800b-4e77-83ca-ad349124e253'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:59.252110 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc980922d9e748f9831c91b98e48827b', 'request_id': 'req-daff9615-800b-4e77-83ca-ad349124e253'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:59.271278 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] The token cache is being invalidate because project bc980922d9e748f9831c91b98e48827b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:21:59.271492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:59.272218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-daff9615-800b-4e77-83ca-ad349124e253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:21:59.274768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1178/2370] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:21:59 2022] DELETE /identity/v3/projects/bc980922d9e748f9831c91b98e48827b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:21:59.282310 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c544e-1bb5-473f-83a8-c76ff4ab7554 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.283243 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c544e-1bb5-473f-83a8-c76ff4ab7554 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.283404 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c544e-1bb5-473f-83a8-c76ff4ab7554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.302361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a61c544e-1bb5-473f-83a8-c76ff4ab7554 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:59.303591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a61c544e-1bb5-473f-83a8-c76ff4ab7554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:59.374021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1193/2371] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:59.381986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bcfa-39d6-42c3-bb84-b8de0d18637b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.383499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bcfa-39d6-42c3-bb84-b8de0d18637b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.383499 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bcfa-39d6-42c3-bb84-b8de0d18637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.403581 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f174bcfa-39d6-42c3-bb84-b8de0d18637b None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:59.404909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f174bcfa-39d6-42c3-bb84-b8de0d18637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:59.414631 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1179/2372] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:59.419807 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c544e-1bb5-473f-83a8-c76ff4ab7554 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:59.430406 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c544e-1bb5-473f-83a8-c76ff4ab7554 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:59.435343 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2555f1b-19ce-4bcb-b654-344435580fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:59.436052 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2555f1b-19ce-4bcb-b654-344435580fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.436585 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2555f1b-19ce-4bcb-b654-344435580fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.436876 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2555f1b-19ce-4bcb-b654-344435580fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.437666 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2555f1b-19ce-4bcb-b654-344435580fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:21:59.437962 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2555f1b-19ce-4bcb-b654-344435580fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:59.439602 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2555f1b-19ce-4bcb-b654-344435580fd2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:59.451958 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1194/2373] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:21:59.456973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174bcfa-39d6-42c3-bb84-b8de0d18637b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:59.473565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174bcfa-39d6-42c3-bb84-b8de0d18637b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:59.479874 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38056f53-d736-40bd-9585-62db655943dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:59.480553 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38056f53-d736-40bd-9585-62db655943dd admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.480839 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38056f53-d736-40bd-9585-62db655943dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.481129 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38056f53-d736-40bd-9585-62db655943dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.481885 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38056f53-d736-40bd-9585-62db655943dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:59.483814 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38056f53-d736-40bd-9585-62db655943dd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:59.512112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1180/2374] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:21:59 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:21:59.516373 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2555f1b-19ce-4bcb-b654-344435580fd2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:59.528038 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2555f1b-19ce-4bcb-b654-344435580fd2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:59.589292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:21:59.606880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ee144-c496-4568-ac53-1945e6d67501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:59.607576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ee144-c496-4568-ac53-1945e6d67501 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.607871 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ee144-c496-4568-ac53-1945e6d67501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.608152 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ee144-c496-4568-ac53-1945e6d67501 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.608875 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ee144-c496-4568-ac53-1945e6d67501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:59.610841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ee144-c496-4568-ac53-1945e6d67501 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:59.634634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1195/2375] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:21:59 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:21:59.639329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38056f53-d736-40bd-9585-62db655943dd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:59.654638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38056f53-d736-40bd-9585-62db655943dd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:59.659727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05402f2-c858-4ac8-b04d-bfefa864d80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:59.660519 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05402f2-c858-4ac8-b04d-bfefa864d80d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.660873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05402f2-c858-4ac8-b04d-bfefa864d80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.661234 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05402f2-c858-4ac8-b04d-bfefa864d80d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.662054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05402f2-c858-4ac8-b04d-bfefa864d80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:59.664310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05402f2-c858-4ac8-b04d-bfefa864d80d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:59.675563 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1181/2376] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:21:59.685421 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ee144-c496-4568-ac53-1945e6d67501 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:59.690761 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ee144-c496-4568-ac53-1945e6d67501 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:59.696635 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2e510-550d-4ddc-a3a3-834f53b77271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:59.697335 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e510-550d-4ddc-a3a3-834f53b77271 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.697684 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e510-550d-4ddc-a3a3-834f53b77271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.697970 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2e510-550d-4ddc-a3a3-834f53b77271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.698724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2e510-550d-4ddc-a3a3-834f53b77271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:59.700332 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2e510-550d-4ddc-a3a3-834f53b77271 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:59.712711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1196/2377] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:21:59.716746 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05402f2-c858-4ac8-b04d-bfefa864d80d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:21:59.728251 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05402f2-c858-4ac8-b04d-bfefa864d80d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:21:59.733034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dbd8c-85c1-4189-b3ad-150ec70c9d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:21:59.733973 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dbd8c-85c1-4189-b3ad-150ec70c9d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.734249 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dbd8c-85c1-4189-b3ad-150ec70c9d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.734525 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dbd8c-85c1-4189-b3ad-150ec70c9d38 admin admin] PATH_INFO: `/v3/projects/734a35348a224cc29a229f2e50eb701b/users/60184d02053440439b8aff14853eb268/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.756979 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dbd8c-85c1-4189-b3ad-150ec70c9d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734a35348a224cc29a229f2e50eb701b, user_id=60184d02053440439b8aff14853eb268, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:21:59.762717 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dbd8c-85c1-4189-b3ad-150ec70c9d38 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:21:59.781566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1182/2378] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:21:59 2022] PUT /identity/v3/projects/734a35348a224cc29a229f2e50eb701b/users/60184d02053440439b8aff14853eb268/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:21:59.794099 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c67161-b0f6-41d6-a14c-bd5b4c4297c2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:21:59.794386 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c67161-b0f6-41d6-a14c-bd5b4c4297c2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:21:59.794712 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c67161-b0f6-41d6-a14c-bd5b4c4297c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:21:59.825065 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e3c67161-b0f6-41d6-a14c-bd5b4c4297c2 None None] MFA Rules not processed for user `60184d02053440439b8aff14853eb268`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:21:59.826324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e3c67161-b0f6-41d6-a14c-bd5b4c4297c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:21:59.913064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1197/2379] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:21:59.918237 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dbd8c-85c1-4189-b3ad-150ec70c9d38 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.024303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dbd8c-85c1-4189-b3ad-150ec70c9d38 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.031768 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfe70c-a1d7-4f8b-ad45-d51d76efb2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.032356 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfe70c-a1d7-4f8b-ad45-d51d76efb2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.032669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfe70c-a1d7-4f8b-ad45-d51d76efb2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.032952 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfe70c-a1d7-4f8b-ad45-d51d76efb2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.033691 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfe70c-a1d7-4f8b-ad45-d51d76efb2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.035662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfe70c-a1d7-4f8b-ad45-d51d76efb2d2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.046712 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:00.073569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1183/2380] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:21:59 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:22:00.075397 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c67161-b0f6-41d6-a14c-bd5b4c4297c2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.089446 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c67161-b0f6-41d6-a14c-bd5b4c4297c2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.164093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9301d5f-ed12-4614-8b37-0ece10fd90c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.164790 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9301d5f-ed12-4614-8b37-0ece10fd90c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.165211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9301d5f-ed12-4614-8b37-0ece10fd90c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.165588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9301d5f-ed12-4614-8b37-0ece10fd90c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.166374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9301d5f-ed12-4614-8b37-0ece10fd90c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.168396 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9301d5f-ed12-4614-8b37-0ece10fd90c2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.192576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1198/2381] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:22:00 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:22:00.197502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfe70c-a1d7-4f8b-ad45-d51d76efb2d2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.215007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfe70c-a1d7-4f8b-ad45-d51d76efb2d2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.220445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc210-78eb-4769-be8a-aa238c2981d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.221085 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc210-78eb-4769-be8a-aa238c2981d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.221373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc210-78eb-4769-be8a-aa238c2981d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.221690 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc210-78eb-4769-be8a-aa238c2981d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.222501 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc210-78eb-4769-be8a-aa238c2981d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.224344 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc210-78eb-4769-be8a-aa238c2981d3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.242821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1184/2382] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:22:00.243061 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9301d5f-ed12-4614-8b37-0ece10fd90c2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.252920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9301d5f-ed12-4614-8b37-0ece10fd90c2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.258973 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f075a1f-ba96-4f37-8ee1-5a9db4e14765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.259374 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f075a1f-ba96-4f37-8ee1-5a9db4e14765 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.259555 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f075a1f-ba96-4f37-8ee1-5a9db4e14765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.259924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f075a1f-ba96-4f37-8ee1-5a9db4e14765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.261004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f075a1f-ba96-4f37-8ee1-5a9db4e14765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.263002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f075a1f-ba96-4f37-8ee1-5a9db4e14765 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.282392 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1199/2383] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:22:00.294059 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc210-78eb-4769-be8a-aa238c2981d3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.314819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc210-78eb-4769-be8a-aa238c2981d3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.324542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a3e2-7c15-43bb-b193-785f2460c782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.327165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a3e2-7c15-43bb-b193-785f2460c782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.327748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a3e2-7c15-43bb-b193-785f2460c782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.328359 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a3e2-7c15-43bb-b193-785f2460c782 admin admin] PATH_INFO: `/v3/projects/6c131f5c8bfd47698201052374686ad9/users/cdd386b7fe59478199326fb0a8830ab5/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.359970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7a3e2-7c15-43bb-b193-785f2460c782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c131f5c8bfd47698201052374686ad9, user_id=cdd386b7fe59478199326fb0a8830ab5, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.365793 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7a3e2-7c15-43bb-b193-785f2460c782 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.390445 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1185/2384] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:22:00 2022] PUT /identity/v3/projects/6c131f5c8bfd47698201052374686ad9/users/cdd386b7fe59478199326fb0a8830ab5/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:00.401007 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fff257-b691-4af8-b4ad-0c3200f64cdb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.401309 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fff257-b691-4af8-b4ad-0c3200f64cdb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.401627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fff257-b691-4af8-b4ad-0c3200f64cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.432820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-96fff257-b691-4af8-b4ad-0c3200f64cdb None None] MFA Rules not processed for user `cdd386b7fe59478199326fb0a8830ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:00.434479 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-96fff257-b691-4af8-b4ad-0c3200f64cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:00.458329 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:00.515209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1200/2385] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:00.521498 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a3e2-7c15-43bb-b193-785f2460c782 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.594202 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a3e2-7c15-43bb-b193-785f2460c782 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.599018 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816167-8cf0-4678-b2cf-9001ed5bc9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.599696 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816167-8cf0-4678-b2cf-9001ed5bc9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.599978 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816167-8cf0-4678-b2cf-9001ed5bc9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.600252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816167-8cf0-4678-b2cf-9001ed5bc9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.601087 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816167-8cf0-4678-b2cf-9001ed5bc9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.603272 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816167-8cf0-4678-b2cf-9001ed5bc9a0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.634727 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1186/2386] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:22:00 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:22:00.636221 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fff257-b691-4af8-b4ad-0c3200f64cdb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.651867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fff257-b691-4af8-b4ad-0c3200f64cdb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.718051 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ead02b-ef4d-4743-9006-cb4cc7403950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.718935 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ead02b-ef4d-4743-9006-cb4cc7403950 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.719219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ead02b-ef4d-4743-9006-cb4cc7403950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.719494 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ead02b-ef4d-4743-9006-cb4cc7403950 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.720198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ead02b-ef4d-4743-9006-cb4cc7403950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.722219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ead02b-ef4d-4743-9006-cb4cc7403950 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.745819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1201/2387] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:22:00 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:22:00.749595 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816167-8cf0-4678-b2cf-9001ed5bc9a0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.764439 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816167-8cf0-4678-b2cf-9001ed5bc9a0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.770085 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d97028-fa0a-4537-9702-d9eb60c1f87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.770763 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d97028-fa0a-4537-9702-d9eb60c1f87a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.771053 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d97028-fa0a-4537-9702-d9eb60c1f87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.771335 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d97028-fa0a-4537-9702-d9eb60c1f87a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.772122 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d97028-fa0a-4537-9702-d9eb60c1f87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.775001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d97028-fa0a-4537-9702-d9eb60c1f87a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.793606 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1187/2388] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:22:00.794824 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ead02b-ef4d-4743-9006-cb4cc7403950 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.806715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ead02b-ef4d-4743-9006-cb4cc7403950 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.811741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3784a-5869-4faa-9c37-8a62aa11088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.812655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3784a-5869-4faa-9c37-8a62aa11088a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.813042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3784a-5869-4faa-9c37-8a62aa11088a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.813259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3784a-5869-4faa-9c37-8a62aa11088a admin admin] PATH_INFO: `/v3/projects/999ef01195a540fa9513634642ecfe16/users/ad685b7a467b422286e3066328b58635/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.830086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3784a-5869-4faa-9c37-8a62aa11088a admin admin] RBAC: Authorizing `identity:create_grant(project_id=999ef01195a540fa9513634642ecfe16, user_id=ad685b7a467b422286e3066328b58635, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.832751 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3784a-5869-4faa-9c37-8a62aa11088a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.855093 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1202/2389] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:22:00 2022] PUT /identity/v3/projects/999ef01195a540fa9513634642ecfe16/users/ad685b7a467b422286e3066328b58635/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:00.859146 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d97028-fa0a-4537-9702-d9eb60c1f87a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.870352 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d97028-fa0a-4537-9702-d9eb60c1f87a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:00.952833 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3c376-b319-46ff-9e97-f463d0c5ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:00.953639 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3c376-b319-46ff-9e97-f463d0c5ff78 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:00.954274 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3c376-b319-46ff-9e97-f463d0c5ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:00.954702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3c376-b319-46ff-9e97-f463d0c5ff78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:00.955640 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3c376-b319-46ff-9e97-f463d0c5ff78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:00.957728 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3c376-b319-46ff-9e97-f463d0c5ff78 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:00.980506 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1188/2390] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:22:00.987802 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3784a-5869-4faa-9c37-8a62aa11088a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:00.997087 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3784a-5869-4faa-9c37-8a62aa11088a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:01.002860 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769d4b5-a848-4e24-adda-ed4e54e579ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:01.003893 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769d4b5-a848-4e24-adda-ed4e54e579ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:01.004248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769d4b5-a848-4e24-adda-ed4e54e579ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:01.004617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769d4b5-a848-4e24-adda-ed4e54e579ea admin admin] PATH_INFO: `/v3/projects/999ef01195a540fa9513634642ecfe16/users/ad685b7a467b422286e3066328b58635/roles/4bdd5f7d3834497fbad569bb21092a6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:01.006869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769d4b5-a848-4e24-adda-ed4e54e579ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=999ef01195a540fa9513634642ecfe16, user_id=ad685b7a467b422286e3066328b58635, role_id=4bdd5f7d3834497fbad569bb21092a6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:01.013145 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769d4b5-a848-4e24-adda-ed4e54e579ea admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:01.021886 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1203/2391] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:22:00 2022] PUT /identity/v3/projects/999ef01195a540fa9513634642ecfe16/users/ad685b7a467b422286e3066328b58635/roles/4bdd5f7d3834497fbad569bb21092a6e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:01.033928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9beb15-7a21-4b82-bc3c-c10d496b3601 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:01.034238 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9beb15-7a21-4b82-bc3c-c10d496b3601 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:01.034515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9beb15-7a21-4b82-bc3c-c10d496b3601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:01.070518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fe9beb15-7a21-4b82-bc3c-c10d496b3601 None None] MFA Rules not processed for user `ad685b7a467b422286e3066328b58635`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:01.071884 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe9beb15-7a21-4b82-bc3c-c10d496b3601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:01.087961 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:01.157783 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1189/2392] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:01.169638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769d4b5-a848-4e24-adda-ed4e54e579ea admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:01.172561 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4769d4b5-a848-4e24-adda-ed4e54e579ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:01.275340 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769d4b5-a848-4e24-adda-ed4e54e579ea admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:01.282385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe7f27-0e25-4d84-a12e-24cbb23dabfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:01.283554 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7f27-0e25-4d84-a12e-24cbb23dabfb service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:01.284159 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7f27-0e25-4d84-a12e-24cbb23dabfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:01.284642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7f27-0e25-4d84-a12e-24cbb23dabfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:01.323128 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:01.357211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe7f27-0e25-4d84-a12e-24cbb23dabfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:01.358740 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe7f27-0e25-4d84-a12e-24cbb23dabfb service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:01.370368 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1204/2393] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:22:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:22:02.949943 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9beb15-7a21-4b82-bc3c-c10d496b3601 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:02.951712 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe9beb15-7a21-4b82-bc3c-c10d496b3601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:02.967792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9beb15-7a21-4b82-bc3c-c10d496b3601 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:02.972233 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e853a6c-f30e-4fcb-bd39-0f76361f8f60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:02.972892 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853a6c-f30e-4fcb-bd39-0f76361f8f60 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:02.973179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853a6c-f30e-4fcb-bd39-0f76361f8f60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:02.973461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853a6c-f30e-4fcb-bd39-0f76361f8f60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:03.040217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e853a6c-f30e-4fcb-bd39-0f76361f8f60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:03.041681 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e853a6c-f30e-4fcb-bd39-0f76361f8f60 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:03.051644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1190/2394] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:22:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:22:03.242023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cfb65-a6b3-4ca3-8159-59ca07cbfaf0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:03.242805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cfb65-a6b3-4ca3-8159-59ca07cbfaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:03.242805 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cfb65-a6b3-4ca3-8159-59ca07cbfaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:03.267302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ec6cfb65-a6b3-4ca3-8159-59ca07cbfaf0 None None] MFA Rules not processed for user `67ff3d88fac84118b43dbe17caad5241`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:03.268694 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ec6cfb65-a6b3-4ca3-8159-59ca07cbfaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:03.336955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1205/2395] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:03.676197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e853a6c-f30e-4fcb-bd39-0f76361f8f60 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:03.686304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e853a6c-f30e-4fcb-bd39-0f76361f8f60 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:03.689974 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040b220-6d84-490c-a6c6-25368e38c1ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:03.690647 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040b220-6d84-490c-a6c6-25368e38c1ef service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:03.690909 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040b220-6d84-490c-a6c6-25368e38c1ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:03.691188 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040b220-6d84-490c-a6c6-25368e38c1ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:03.703919 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040b220-6d84-490c-a6c6-25368e38c1ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:03.705419 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040b220-6d84-490c-a6c6-25368e38c1ef service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:03.716402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1191/2396] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:22:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:22:07.733920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cfb65-a6b3-4ca3-8159-59ca07cbfaf0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:07.803289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cfb65-a6b3-4ca3-8159-59ca07cbfaf0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:07.809841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:07.810735 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:07.811022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:07.811303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] PATH_INFO: `/v3/users/60184d02053440439b8aff14853eb268` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:07.812529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60184d02053440439b8aff14853eb268)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:07.814510 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:07.867183 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60184d02053440439b8aff14853eb268'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:07.879503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60184d02053440439b8aff14853eb268'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:07.886529 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60184d02053440439b8aff14853eb268'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:07.887237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60184d02053440439b8aff14853eb268'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:07.887828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60184d02053440439b8aff14853eb268'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:07.890507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:07.907073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1206/2397] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:22:07 2022] DELETE /identity/v3/users/60184d02053440439b8aff14853eb268 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:07.911711 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60840a1b-ae20-48a1-bbc8-1b32e95d3351 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:07.912205 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60840a1b-ae20-48a1-bbc8-1b32e95d3351 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:07.912303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60840a1b-ae20-48a1-bbc8-1b32e95d3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:07.936877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-60840a1b-ae20-48a1-bbc8-1b32e95d3351 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:07.938150 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-60840a1b-ae20-48a1-bbc8-1b32e95d3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:08.004626 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1192/2398] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:08.015125 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:08.016606 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:08.087799 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa9e9-375e-404e-ae04-b528a61a42e0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:08.091727 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88872e0-a3ff-4e01-8b0f-aa3c7781dae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:08.092366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88872e0-a3ff-4e01-8b0f-aa3c7781dae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:08.092648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88872e0-a3ff-4e01-8b0f-aa3c7781dae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:08.092924 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88872e0-a3ff-4e01-8b0f-aa3c7781dae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:08.103437 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88872e0-a3ff-4e01-8b0f-aa3c7781dae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:08.104892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88872e0-a3ff-4e01-8b0f-aa3c7781dae8 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:08.115106 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1207/2399] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:22:08.429706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60840a1b-ae20-48a1-bbc8-1b32e95d3351 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:08.431315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-60840a1b-ae20-48a1-bbc8-1b32e95d3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:08.444338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60840a1b-ae20-48a1-bbc8-1b32e95d3351 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:08.450105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:08.451402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:08.451736 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:08.452014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] PATH_INFO: `/v3/projects/734a35348a224cc29a229f2e50eb701b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:08.454103 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734a35348a224cc29a229f2e50eb701b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:08.456165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:08.498203 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:08.513616 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734a35348a224cc29a229f2e50eb701b', 'request_id': 'req-3c974a3d-011d-4a0a-9f00-953fd060cd97'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.521463 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734a35348a224cc29a229f2e50eb701b', 'request_id': 'req-3c974a3d-011d-4a0a-9f00-953fd060cd97'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.527796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734a35348a224cc29a229f2e50eb701b', 'request_id': 'req-3c974a3d-011d-4a0a-9f00-953fd060cd97'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.540220 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] The token cache is being invalidate because project 734a35348a224cc29a229f2e50eb701b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:22:08.540500 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.541179 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.542778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1193/2400] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:22:08 2022] DELETE /identity/v3/projects/734a35348a224cc29a229f2e50eb701b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:08.546900 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88872e0-a3ff-4e01-8b0f-aa3c7781dae8 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:08.557464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88872e0-a3ff-4e01-8b0f-aa3c7781dae8 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:08.619806 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:08.620690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:08.620993 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:08.621275 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] PATH_INFO: `/v3/users/cdd386b7fe59478199326fb0a8830ab5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:08.622535 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd386b7fe59478199326fb0a8830ab5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:08.624505 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:08.688915 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd386b7fe59478199326fb0a8830ab5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.702297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd386b7fe59478199326fb0a8830ab5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.710536 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd386b7fe59478199326fb0a8830ab5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.711516 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd386b7fe59478199326fb0a8830ab5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.711926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd386b7fe59478199326fb0a8830ab5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:08.725840 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1208/2401] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:22:08 2022] DELETE /identity/v3/users/cdd386b7fe59478199326fb0a8830ab5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:09.122159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:09.123780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:09.143604 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c974a3d-011d-4a0a-9f00-953fd060cd97 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:09.209877 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:09.210972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:09.211249 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:09.211523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] PATH_INFO: `/v3/projects/6c131f5c8bfd47698201052374686ad9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:09.212725 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c131f5c8bfd47698201052374686ad9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:09.214878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:09.266157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c131f5c8bfd47698201052374686ad9', 'request_id': 'req-0239f752-ad87-46b2-9960-8cb6b4a79814'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.275347 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c131f5c8bfd47698201052374686ad9', 'request_id': 'req-0239f752-ad87-46b2-9960-8cb6b4a79814'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.282030 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c131f5c8bfd47698201052374686ad9', 'request_id': 'req-0239f752-ad87-46b2-9960-8cb6b4a79814'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.294020 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] The token cache is being invalidate because project 6c131f5c8bfd47698201052374686ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:22:09.294307 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.294966 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.296682 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1194/2402] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:22:09 2022] DELETE /identity/v3/projects/6c131f5c8bfd47698201052374686ad9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:09.300655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:09.302073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:09.315783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8ccb0-c68c-491c-8bca-306f270a65d4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:09.328422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:09.383131 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:09.384484 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:09.384955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:09.385405 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] PATH_INFO: `/v3/users/ad685b7a467b422286e3066328b58635` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:09.387439 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad685b7a467b422286e3066328b58635)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:09.390844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:09.458853 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad685b7a467b422286e3066328b58635'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.471588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad685b7a467b422286e3066328b58635'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.479303 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad685b7a467b422286e3066328b58635'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.480050 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad685b7a467b422286e3066328b58635'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.480647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70bdfef6-34bc-4a55-ad51-8b6a7d53b2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad685b7a467b422286e3066328b58635'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.500105 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1209/2403] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:22:09 2022] DELETE /identity/v3/users/ad685b7a467b422286e3066328b58635 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:09.812380 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:09.814036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:09.830842 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239f752-ad87-46b2-9960-8cb6b4a79814 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:09.880112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:09.896767 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:09.898523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:09.898823 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:09.899182 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] PATH_INFO: `/v3/projects/999ef01195a540fa9513634642ecfe16` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:09.900486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=999ef01195a540fa9513634642ecfe16)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:09.902469 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:09.958055 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999ef01195a540fa9513634642ecfe16', 'request_id': 'req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.967340 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999ef01195a540fa9513634642ecfe16', 'request_id': 'req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:09.977273 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999ef01195a540fa9513634642ecfe16', 'request_id': 'req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:10.002644 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] The token cache is being invalidate because project 999ef01195a540fa9513634642ecfe16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:22:10.002963 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:10.003704 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6498b09-0e8d-49cb-9c60-fe1fcd524d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:10.005301 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1195/2404] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:22:09 2022] DELETE /identity/v3/projects/999ef01195a540fa9513634642ecfe16 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 15:22:10.011201 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43f6f6-fa7a-411d-9ec0-e5daf4524acc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.011699 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43f6f6-fa7a-411d-9ec0-e5daf4524acc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.012161 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43f6f6-fa7a-411d-9ec0-e5daf4524acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.040762 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8b43f6f6-fa7a-411d-9ec0-e5daf4524acc None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:10.042484 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8b43f6f6-fa7a-411d-9ec0-e5daf4524acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:10.118073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1210/2405] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:10.127201 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f32d7-495f-4d88-a85c-1d691b4ccd11 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.127718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f32d7-495f-4d88-a85c-1d691b4ccd11 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.127829 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f32d7-495f-4d88-a85c-1d691b4ccd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.148151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3d8f32d7-495f-4d88-a85c-1d691b4ccd11 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:10.150105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d8f32d7-495f-4d88-a85c-1d691b4ccd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:10.158492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1196/2406] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:10.163068 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43f6f6-fa7a-411d-9ec0-e5daf4524acc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:10.181794 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43f6f6-fa7a-411d-9ec0-e5daf4524acc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:10.191096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce6790-7941-415f-92f3-67fd3aebc136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:10.191784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6790-7941-415f-92f3-67fd3aebc136 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.192091 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6790-7941-415f-92f3-67fd3aebc136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.192334 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6790-7941-415f-92f3-67fd3aebc136 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.193064 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce6790-7941-415f-92f3-67fd3aebc136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:22:10.193375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce6790-7941-415f-92f3-67fd3aebc136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:10.196035 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce6790-7941-415f-92f3-67fd3aebc136 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:10.210995 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1211/2407] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:22:10.215972 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f32d7-495f-4d88-a85c-1d691b4ccd11 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:10.225458 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f32d7-495f-4d88-a85c-1d691b4ccd11 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:10.231808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355e754-21e9-4eb6-a827-2a9d349a6412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:10.232474 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355e754-21e9-4eb6-a827-2a9d349a6412 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.232756 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355e754-21e9-4eb6-a827-2a9d349a6412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.233028 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355e754-21e9-4eb6-a827-2a9d349a6412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.233766 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355e754-21e9-4eb6-a827-2a9d349a6412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:10.235665 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355e754-21e9-4eb6-a827-2a9d349a6412 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:10.282108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1197/2408] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:22:10 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 15:22:10.286312 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce6790-7941-415f-92f3-67fd3aebc136 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:10.299324 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce6790-7941-415f-92f3-67fd3aebc136 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:10.321209 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:10.369140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1ce25-dff8-47ce-9d4b-073932562c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:10.369864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1ce25-dff8-47ce-9d4b-073932562c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.370211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1ce25-dff8-47ce-9d4b-073932562c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.370433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1ce25-dff8-47ce-9d4b-073932562c06 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.371142 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1ce25-dff8-47ce-9d4b-073932562c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:10.373135 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1ce25-dff8-47ce-9d4b-073932562c06 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:10.399083 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1212/2409] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:22:10 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:22:10.405585 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355e754-21e9-4eb6-a827-2a9d349a6412 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:10.416848 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355e754-21e9-4eb6-a827-2a9d349a6412 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:10.421662 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1829cc1-e9fd-4db0-96a8-a2f3ef668fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:10.422337 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1829cc1-e9fd-4db0-96a8-a2f3ef668fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.422636 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1829cc1-e9fd-4db0-96a8-a2f3ef668fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.422916 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1829cc1-e9fd-4db0-96a8-a2f3ef668fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.423657 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1829cc1-e9fd-4db0-96a8-a2f3ef668fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:10.425304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1829cc1-e9fd-4db0-96a8-a2f3ef668fcb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:10.436694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1198/2410] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:22:10.441965 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1ce25-dff8-47ce-9d4b-073932562c06 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:10.453323 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1ce25-dff8-47ce-9d4b-073932562c06 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:10.464929 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95f122-acef-4798-a76a-bd8fe6252f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:10.465648 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95f122-acef-4798-a76a-bd8fe6252f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.465945 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95f122-acef-4798-a76a-bd8fe6252f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.466227 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95f122-acef-4798-a76a-bd8fe6252f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.466976 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95f122-acef-4798-a76a-bd8fe6252f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:10.468596 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95f122-acef-4798-a76a-bd8fe6252f93 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:10.480519 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1213/2411] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:22:10.484402 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1829cc1-e9fd-4db0-96a8-a2f3ef668fcb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:10.495164 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1829cc1-e9fd-4db0-96a8-a2f3ef668fcb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:10.499986 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248c818-2204-4bcd-a205-3a11d9cd50ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:10.500907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248c818-2204-4bcd-a205-3a11d9cd50ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.501193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248c818-2204-4bcd-a205-3a11d9cd50ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.501515 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248c818-2204-4bcd-a205-3a11d9cd50ee admin admin] PATH_INFO: `/v3/projects/8bf89acb14bc4e32be3ba2a6128becf5/users/dbae884d72764e06bf7576d1aa6e9f80/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.519001 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248c818-2204-4bcd-a205-3a11d9cd50ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf89acb14bc4e32be3ba2a6128becf5, user_id=dbae884d72764e06bf7576d1aa6e9f80, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:10.521856 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248c818-2204-4bcd-a205-3a11d9cd50ee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:10.548331 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1199/2412] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:22:10 2022] PUT /identity/v3/projects/8bf89acb14bc4e32be3ba2a6128becf5/users/dbae884d72764e06bf7576d1aa6e9f80/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:10.549449 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67f3e0-58cc-4e52-b3cd-c417a02cf3f1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.549801 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67f3e0-58cc-4e52-b3cd-c417a02cf3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.550253 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67f3e0-58cc-4e52-b3cd-c417a02cf3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.581360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8a67f3e0-58cc-4e52-b3cd-c417a02cf3f1 None None] MFA Rules not processed for user `dbae884d72764e06bf7576d1aa6e9f80`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:10.582629 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8a67f3e0-58cc-4e52-b3cd-c417a02cf3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:10.665647 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1214/2413] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:10.677016 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248c818-2204-4bcd-a205-3a11d9cd50ee admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:10.679298 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0248c818-2204-4bcd-a205-3a11d9cd50ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:10.742846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248c818-2204-4bcd-a205-3a11d9cd50ee admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:10.746565 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081a676-d1c6-4f7f-aa15-ea42abd3adad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ac2738bf434afabe3d227dc5e52650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:10.747222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081a676-d1c6-4f7f-aa15-ea42abd3adad service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:10.747502 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081a676-d1c6-4f7f-aa15-ea42abd3adad service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:10.747780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081a676-d1c6-4f7f-aa15-ea42abd3adad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:10.756808 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081a676-d1c6-4f7f-aa15-ea42abd3adad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:10.759281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081a676-d1c6-4f7f-aa15-ea42abd3adad service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:10.769007 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1200/2414] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:22:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:22:20.662451 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=56,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:20.764599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:48.104070 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67f3e0-58cc-4e52-b3cd-c417a02cf3f1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:48.167493 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67f3e0-58cc-4e52-b3cd-c417a02cf3f1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:48.172016 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:48.172885 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:48.173191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:48.173482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] PATH_INFO: `/v3/users/dbae884d72764e06bf7576d1aa6e9f80` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:48.174688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbae884d72764e06bf7576d1aa6e9f80)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:48.176601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:48.223255 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbae884d72764e06bf7576d1aa6e9f80'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.235844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbae884d72764e06bf7576d1aa6e9f80'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.243741 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbae884d72764e06bf7576d1aa6e9f80'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.244485 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbae884d72764e06bf7576d1aa6e9f80'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.245095 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbae884d72764e06bf7576d1aa6e9f80'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.258079 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1215/2415] 10.222.0.90 () {58 vars in 1223 bytes} [Tue Jun 21 15:22:48 2022] DELETE /identity/v3/users/dbae884d72764e06bf7576d1aa6e9f80 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:48.262706 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248ed26-fbfd-4747-8d95-27e315576f5e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:48.263187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248ed26-fbfd-4747-8d95-27e315576f5e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:48.263318 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248ed26-fbfd-4747-8d95-27e315576f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:48.281675 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1248ed26-fbfd-4747-8d95-27e315576f5e None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:48.282890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1248ed26-fbfd-4747-8d95-27e315576f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:48.343105 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1201/2416] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:48.354378 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:48.355841 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:48.413548 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd75dc-f491-4b51-a8cb-95d2accde8d1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:48.417197 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e101-7410-4a31-be5a-35c8a425a64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:48.417873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e101-7410-4a31-be5a-35c8a425a64f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:48.418156 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e101-7410-4a31-be5a-35c8a425a64f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:48.418432 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e101-7410-4a31-be5a-35c8a425a64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:48.428364 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e101-7410-4a31-be5a-35c8a425a64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:48.430042 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e101-7410-4a31-be5a-35c8a425a64f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:48.440094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1216/2417] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:22:48.712231 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248ed26-fbfd-4747-8d95-27e315576f5e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:48.713815 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1248ed26-fbfd-4747-8d95-27e315576f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:48.726679 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248ed26-fbfd-4747-8d95-27e315576f5e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:48.732507 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:48.733524 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:48.733807 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:48.734139 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] PATH_INFO: `/v3/projects/8bf89acb14bc4e32be3ba2a6128becf5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:48.735938 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf89acb14bc4e32be3ba2a6128becf5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:48.738076 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:48.799080 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf89acb14bc4e32be3ba2a6128becf5', 'request_id': 'req-fd160127-0c28-4643-a409-ace97d4993f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.808286 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf89acb14bc4e32be3ba2a6128becf5', 'request_id': 'req-fd160127-0c28-4643-a409-ace97d4993f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.814488 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf89acb14bc4e32be3ba2a6128becf5', 'request_id': 'req-fd160127-0c28-4643-a409-ace97d4993f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.827599 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] The token cache is being invalidate because project 8bf89acb14bc4e32be3ba2a6128becf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 15:22:48.827865 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.828549 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd160127-0c28-4643-a409-ace97d4993f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 15:22:48.830123 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1202/2418] 10.222.0.90 () {58 vars in 1232 bytes} [Tue Jun 21 15:22:48 2022] DELETE /identity/v3/projects/8bf89acb14bc4e32be3ba2a6128becf5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:48.835707 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2401c-13b8-4d68-9469-697c0fc6690a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:48.836049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2401c-13b8-4d68-9469-697c0fc6690a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:48.836342 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2401c-13b8-4d68-9469-697c0fc6690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:48.854734 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-47a2401c-13b8-4d68-9469-697c0fc6690a None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:48.855952 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-47a2401c-13b8-4d68-9469-697c0fc6690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:48.874428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:48.921820 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1217/2419] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:22:48.930947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377e2e-26af-41b8-bf20-ddc64b8bb04e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:48.931329 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377e2e-26af-41b8-bf20-ddc64b8bb04e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:48.931718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377e2e-26af-41b8-bf20-ddc64b8bb04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:48.951965 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cb377e2e-26af-41b8-bf20-ddc64b8bb04e None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:48.953193 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cb377e2e-26af-41b8-bf20-ddc64b8bb04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:48.963504 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1203/2420] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:48.968721 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2401c-13b8-4d68-9469-697c0fc6690a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:48.980828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2401c-13b8-4d68-9469-697c0fc6690a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:48.985963 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a35f9-e8db-49c2-afbd-247729714883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:48.986634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a35f9-e8db-49c2-afbd-247729714883 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:48.986917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a35f9-e8db-49c2-afbd-247729714883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:48.987198 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a35f9-e8db-49c2-afbd-247729714883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:48.987938 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a35f9-e8db-49c2-afbd-247729714883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 15:22:48.988254 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a35f9-e8db-49c2-afbd-247729714883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:48.989911 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a35f9-e8db-49c2-afbd-247729714883 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:49.004229 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1218/2421] 10.222.0.90 () {58 vars in 1152 bytes} [Tue Jun 21 15:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 15:22:49.009252 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377e2e-26af-41b8-bf20-ddc64b8bb04e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:49.019289 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377e2e-26af-41b8-bf20-ddc64b8bb04e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:49.026233 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fa9c0-b043-473a-973e-49222ffb2a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:49.026911 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fa9c0-b043-473a-973e-49222ffb2a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:49.027198 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fa9c0-b043-473a-973e-49222ffb2a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:49.027473 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fa9c0-b043-473a-973e-49222ffb2a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:49.028443 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fa9c0-b043-473a-973e-49222ffb2a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:49.030399 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fa9c0-b043-473a-973e-49222ffb2a09 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:49.061218 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1204/2422] 10.222.0.90 () {60 vars in 1152 bytes} [Tue Jun 21 15:22:49 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:22:49.064957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a35f9-e8db-49c2-afbd-247729714883 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:49.075237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a35f9-e8db-49c2-afbd-247729714883 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:49.143183 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4caa9-ba8a-4ad7-8ad1-6805cdc84a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:49.143861 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4caa9-ba8a-4ad7-8ad1-6805cdc84a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:49.144148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4caa9-ba8a-4ad7-8ad1-6805cdc84a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:49.144427 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4caa9-ba8a-4ad7-8ad1-6805cdc84a6e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:49.145130 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4caa9-ba8a-4ad7-8ad1-6805cdc84a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:49.147126 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4caa9-ba8a-4ad7-8ad1-6805cdc84a6e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:49.171785 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1219/2423] 10.222.0.90 () {60 vars in 1143 bytes} [Tue Jun 21 15:22:49 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 15:22:49.175853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fa9c0-b043-473a-973e-49222ffb2a09 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:49.195338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fa9c0-b043-473a-973e-49222ffb2a09 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:49.200302 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbf2db-c016-4e0d-bb7f-d43bd0097215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:49.200970 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbf2db-c016-4e0d-bb7f-d43bd0097215 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:49.201256 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbf2db-c016-4e0d-bb7f-d43bd0097215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:49.201566 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbf2db-c016-4e0d-bb7f-d43bd0097215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:49.202303 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbf2db-c016-4e0d-bb7f-d43bd0097215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:49.203906 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbf2db-c016-4e0d-bb7f-d43bd0097215 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:49.214789 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1205/2424] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 15:22:49.218895 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4caa9-ba8a-4ad7-8ad1-6805cdc84a6e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:49.229590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4caa9-ba8a-4ad7-8ad1-6805cdc84a6e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:49.234302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8610bce-68ee-46ae-aaf0-bb2059ddbd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:49.234964 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8610bce-68ee-46ae-aaf0-bb2059ddbd75 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:49.235250 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8610bce-68ee-46ae-aaf0-bb2059ddbd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:49.235533 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8610bce-68ee-46ae-aaf0-bb2059ddbd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:49.236286 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8610bce-68ee-46ae-aaf0-bb2059ddbd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:49.237910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8610bce-68ee-46ae-aaf0-bb2059ddbd75 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:49.248917 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1220/2425] 10.222.0.90 () {58 vars in 1121 bytes} [Tue Jun 21 15:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 15:22:49.253086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbf2db-c016-4e0d-bb7f-d43bd0097215 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:49.263491 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbf2db-c016-4e0d-bb7f-d43bd0097215 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:49.268241 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063f50-0e24-4480-ac59-2e81525dacb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '942b864bb91e4374a593803fb944209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48272287173249c5b6cf381e320026f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:49.269113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063f50-0e24-4480-ac59-2e81525dacb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:49.269400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063f50-0e24-4480-ac59-2e81525dacb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:49.269715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063f50-0e24-4480-ac59-2e81525dacb3 admin admin] PATH_INFO: `/v3/projects/55f56c0953fc46cfaa0375ee321b6ce2/users/49c5d8480fbb4fe7b695924da4e9afa5/roles/fefbf89e7cb947a4a9651f4554c49df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:49.284641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0063f50-0e24-4480-ac59-2e81525dacb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f56c0953fc46cfaa0375ee321b6ce2, user_id=49c5d8480fbb4fe7b695924da4e9afa5, role_id=fefbf89e7cb947a4a9651f4554c49df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:49.288106 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0063f50-0e24-4480-ac59-2e81525dacb3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:49.301381 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1206/2426] 10.222.0.90 () {60 vars in 1482 bytes} [Tue Jun 21 15:22:49 2022] PUT /identity/v3/projects/55f56c0953fc46cfaa0375ee321b6ce2/users/49c5d8480fbb4fe7b695924da4e9afa5/roles/fefbf89e7cb947a4a9651f4554c49df8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 15:22:49.307073 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee154b2-2ce6-4278-92e4-8693d0e55984 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:49.307366 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee154b2-2ce6-4278-92e4-8693d0e55984 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:49.307645 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee154b2-2ce6-4278-92e4-8693d0e55984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:49.325194 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4ee154b2-2ce6-4278-92e4-8693d0e55984 None None] MFA Rules not processed for user `942b864bb91e4374a593803fb944209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:49.326408 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ee154b2-2ce6-4278-92e4-8693d0e55984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:49.387710 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1221/2427] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:22:49.397715 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063f50-0e24-4480-ac59-2e81525dacb3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:49.399395 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d0063f50-0e24-4480-ac59-2e81525dacb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:49.425425 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:49.468907 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063f50-0e24-4480-ac59-2e81525dacb3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:49.472540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e96bd-bafb-495f-a71b-fd8639897b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:49.473185 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e96bd-bafb-495f-a71b-fd8639897b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:49.473492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e96bd-bafb-495f-a71b-fd8639897b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:49.473778 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e96bd-bafb-495f-a71b-fd8639897b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:49.483648 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e96bd-bafb-495f-a71b-fd8639897b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:49.485066 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e96bd-bafb-495f-a71b-fd8639897b4d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:49.494523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1207/2428] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:22:50.113724 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a487-08e2-44e4-b2c4-4041dcabeaf9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:50.114020 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a487-08e2-44e4-b2c4-4041dcabeaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:50.114302 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a487-08e2-44e4-b2c4-4041dcabeaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:50.142046 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3136a487-08e2-44e4-b2c4-4041dcabeaf9 None None] MFA Rules not processed for user `49c5d8480fbb4fe7b695924da4e9afa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:50.143252 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3136a487-08e2-44e4-b2c4-4041dcabeaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:50.160926 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:22:50.225858 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1222/2429] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:22:50.235638 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e96bd-bafb-495f-a71b-fd8639897b4d service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:22:50.237450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe2e96bd-bafb-495f-a71b-fd8639897b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:50.310742 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e96bd-bafb-495f-a71b-fd8639897b4d service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:22:50.314423 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ed1d4-b077-4811-8e1f-b9df37d29f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:22:50.315070 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ed1d4-b077-4811-8e1f-b9df37d29f3a service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:50.315356 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ed1d4-b077-4811-8e1f-b9df37d29f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:50.315633 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ed1d4-b077-4811-8e1f-b9df37d29f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:50.324373 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ed1d4-b077-4811-8e1f-b9df37d29f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:22:50.325832 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ed1d4-b077-4811-8e1f-b9df37d29f3a service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:22:50.335486 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1208/2430] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:22:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:22:51.695738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35576de-a4d1-45a6-8906-54b4c6e0d174 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:22:51.695738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35576de-a4d1-45a6-8906-54b4c6e0d174 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:22:51.695738 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35576de-a4d1-45a6-8906-54b4c6e0d174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:22:51.714271 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e35576de-a4d1-45a6-8906-54b4c6e0d174 None None] MFA Rules not processed for user `49c5d8480fbb4fe7b695924da4e9afa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:22:51.715477 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e35576de-a4d1-45a6-8906-54b4c6e0d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:22:51.722385 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1223/2431] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:23:00.330641 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=43 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:23:01.707482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=22 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:23:09.383956 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c11be6-ac22-46b1-a8f9-2de36cf76429 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:23:09.384569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c11be6-ac22-46b1-a8f9-2de36cf76429 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:23:09.384569 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c11be6-ac22-46b1-a8f9-2de36cf76429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:23:09.403320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-11c11be6-ac22-46b1-a8f9-2de36cf76429 None None] MFA Rules not processed for user `d56ce8a772d7417eb4224f3e13cc0759`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:23:09.404542 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11c11be6-ac22-46b1-a8f9-2de36cf76429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:23:09.482912 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1209/2432] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:23:19.469221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=25 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:23:26.423935 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35576de-a4d1-45a6-8906-54b4c6e0d174 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:23:26.434955 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35576de-a4d1-45a6-8906-54b4c6e0d174 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:23:26.438503 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:23:26.439140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:23:26.439428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:23:26.439711 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:23:26.441491 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:23:26.513292 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:23:26.514927 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:23:26.527534 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1224/2433] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:23:27.709847 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c11be6-ac22-46b1-a8f9-2de36cf76429 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:23:27.711320 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11c11be6-ac22-46b1-a8f9-2de36cf76429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:23:27.723437 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c11be6-ac22-46b1-a8f9-2de36cf76429 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:23:27.728063 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8934c-a1c3-4607-843b-69963122ddb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:23:27.728890 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8934c-a1c3-4607-843b-69963122ddb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:23:27.729173 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8934c-a1c3-4607-843b-69963122ddb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:23:27.729461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8934c-a1c3-4607-843b-69963122ddb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:23:27.731465 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8bf8934c-a1c3-4607-843b-69963122ddb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:23:27.746360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8934c-a1c3-4607-843b-69963122ddb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:23:27.747775 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8934c-a1c3-4607-843b-69963122ddb6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:23:27.759630 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1210/2434] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:23:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:23:36.521381 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=34 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:23:37.754224 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:23:51.853901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:23:51.855428 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:23:51.870017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189797b-6872-4da8-919c-abfe5b68aaef service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:23:51.877950 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:23:51.878607 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:23:51.878892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:23:51.879211 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:23:51.882613 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:23:51.973453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:23:51.975688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:23:51.996777 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1225/2435] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:23:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:23:54.431895 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d82a60-c6de-43ff-a73c-3bbf802feb45 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:23:54.432483 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d82a60-c6de-43ff-a73c-3bbf802feb45 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:23:54.432998 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d82a60-c6de-43ff-a73c-3bbf802feb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:23:54.456505 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e1d82a60-c6de-43ff-a73c-3bbf802feb45 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:23:54.458518 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e1d82a60-c6de-43ff-a73c-3bbf802feb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:23:54.529163 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1211/2436] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:23:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:23:54.601225 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:23:54.602678 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:23:54.673642 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d09e59-02c2-4f3c-ad60-0402a031eaf5 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:23:54.679050 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce790-cc20-4f64-86b6-a54480184c4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:23:54.679702 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce790-cc20-4f64-86b6-a54480184c4c service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:23:54.680022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce790-cc20-4f64-86b6-a54480184c4c service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:23:54.680261 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce790-cc20-4f64-86b6-a54480184c4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:23:54.689021 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcce790-cc20-4f64-86b6-a54480184c4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:23:54.690627 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcce790-cc20-4f64-86b6-a54480184c4c service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:23:54.699758 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1226/2437] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:23:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:23:58.055376 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d82a60-c6de-43ff-a73c-3bbf802feb45 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:23:58.070478 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d82a60-c6de-43ff-a73c-3bbf802feb45 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:23:58.078371 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48343e-e12c-42f3-9621-56705d862359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:23:58.080338 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48343e-e12c-42f3-9621-56705d862359 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:23:58.083559 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48343e-e12c-42f3-9621-56705d862359 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:23:58.083947 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48343e-e12c-42f3-9621-56705d862359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:23:58.086143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dc48343e-e12c-42f3-9621-56705d862359 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:23:58.188995 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48343e-e12c-42f3-9621-56705d862359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:23:58.191694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48343e-e12c-42f3-9621-56705d862359 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:23:58.212869 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1212/2438] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:23:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:24:04.696410 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=73 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:24:08.204266 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=53 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:24:09.569063 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce790-cc20-4f64-86b6-a54480184c4c service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:09.578507 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce790-cc20-4f64-86b6-a54480184c4c service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:09.582092 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64843447-b68b-4a18-ae1c-96d8e7871187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:09.582788 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64843447-b68b-4a18-ae1c-96d8e7871187 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:09.583003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64843447-b68b-4a18-ae1c-96d8e7871187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:09.583834 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64843447-b68b-4a18-ae1c-96d8e7871187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:09.585892 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-64843447-b68b-4a18-ae1c-96d8e7871187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:09.597017 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64843447-b68b-4a18-ae1c-96d8e7871187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:09.599817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64843447-b68b-4a18-ae1c-96d8e7871187 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:09.610002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1227/2439] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:24:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:24:13.744113 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e1db8-83e8-4b16-8fff-383238afa73c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:13.744879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e1db8-83e8-4b16-8fff-383238afa73c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:13.744879 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e1db8-83e8-4b16-8fff-383238afa73c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:13.746904 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1213/2440] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:24:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:24:13.762682 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda636d8-7f4a-439f-be82-b0627e38acfb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:13.763270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda636d8-7f4a-439f-be82-b0627e38acfb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:13.763270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda636d8-7f4a-439f-be82-b0627e38acfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:13.786484 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dda636d8-7f4a-439f-be82-b0627e38acfb None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:24:13.787634 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dda636d8-7f4a-439f-be82-b0627e38acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:13.797726 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1228/2441] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:24:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:24:13.810208 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e1db8-83e8-4b16-8fff-383238afa73c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:13.812157 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f3e1db8-83e8-4b16-8fff-383238afa73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:13.893694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e1db8-83e8-4b16-8fff-383238afa73c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:13.898562 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476307a3-39e0-4cf9-a115-1e087f4fdd44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ac2738bf434afabe3d227dc5e52650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:13.899315 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476307a3-39e0-4cf9-a115-1e087f4fdd44 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:13.899602 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476307a3-39e0-4cf9-a115-1e087f4fdd44 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:13.899878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476307a3-39e0-4cf9-a115-1e087f4fdd44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:13.918035 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476307a3-39e0-4cf9-a115-1e087f4fdd44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:13.919488 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476307a3-39e0-4cf9-a115-1e087f4fdd44 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:13.933801 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1214/2442] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:24:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:24:14.015863 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0bf6f-ea5b-44af-9a5a-0e8e661b3f53 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:14.016157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0bf6f-ea5b-44af-9a5a-0e8e661b3f53 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:14.016440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0bf6f-ea5b-44af-9a5a-0e8e661b3f53 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:14.017898 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1229/2443] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:24:14.023771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e8fd-e82e-4e21-a59f-11fe8385b1eb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:14.024067 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e8fd-e82e-4e21-a59f-11fe8385b1eb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:14.024381 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e8fd-e82e-4e21-a59f-11fe8385b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:14.064537 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-14b7e8fd-e82e-4e21-a59f-11fe8385b1eb None None] MFA Rules not processed for user `08b3093a7415419cbb6d50701b09b7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:24:14.065770 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-14b7e8fd-e82e-4e21-a59f-11fe8385b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:14.074932 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1215/2444] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:24:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:24:14.087464 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0bf6f-ea5b-44af-9a5a-0e8e661b3f53 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:14.099582 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0bf6f-ea5b-44af-9a5a-0e8e661b3f53 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:14.103147 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb5de2-4ced-483d-8a87-d9933332feaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:14.103784 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb5de2-4ced-483d-8a87-d9933332feaa service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:14.104066 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb5de2-4ced-483d-8a87-d9933332feaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:14.104341 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb5de2-4ced-483d-8a87-d9933332feaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:14.111928 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb5de2-4ced-483d-8a87-d9933332feaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:14.113350 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb5de2-4ced-483d-8a87-d9933332feaa service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:14.121844 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1230/2445] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:24:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:24:14.215378 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e2f3-48ab-406d-b4a1-efb6b3ea8c41 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:14.215872 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e2f3-48ab-406d-b4a1-efb6b3ea8c41 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:14.216379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e2f3-48ab-406d-b4a1-efb6b3ea8c41 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:14.218759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1216/2446] 10.222.0.90 () {54 vars in 921 bytes} [Tue Jun 21 15:24:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 15:24:14.225157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8ed52-cee6-46b2-aaff-46033de0dbb4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:14.225465 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8ed52-cee6-46b2-aaff-46033de0dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:14.225872 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8ed52-cee6-46b2-aaff-46033de0dbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:14.245388 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2ac8ed52-cee6-46b2-aaff-46033de0dbb4 None None] MFA Rules not processed for user `2bd3ffc0a30648139b2cbf19bb6bd535`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:24:14.246661 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ac8ed52-cee6-46b2-aaff-46033de0dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:14.256901 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1231/2447] 10.222.0.90 () {58 vars in 1018 bytes} [Tue Jun 21 15:24:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:24:14.267899 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e2f3-48ab-406d-b4a1-efb6b3ea8c41 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:14.279864 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e2f3-48ab-406d-b4a1-efb6b3ea8c41 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:14.283753 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098df9c-ef31-4643-a8f1-7e7dd5d1b3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:14.284464 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098df9c-ef31-4643-a8f1-7e7dd5d1b3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:14.284754 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098df9c-ef31-4643-a8f1-7e7dd5d1b3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:14.285036 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098df9c-ef31-4643-a8f1-7e7dd5d1b3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:14.304369 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098df9c-ef31-4643-a8f1-7e7dd5d1b3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:14.305889 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098df9c-ef31-4643-a8f1-7e7dd5d1b3d0 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:14.318612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1217/2448] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:24:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:24:14.394391 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8ed52-cee6-46b2-aaff-46033de0dbb4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:14.395910 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ac8ed52-cee6-46b2-aaff-46033de0dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:14.470056 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8ed52-cee6-46b2-aaff-46033de0dbb4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:14.476441 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedcf64-b9c0-4c14-b1ad-4692f454bdab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:14.477100 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedcf64-b9c0-4c14-b1ad-4692f454bdab service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:14.477382 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedcf64-b9c0-4c14-b1ad-4692f454bdab service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:14.477688 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedcf64-b9c0-4c14-b1ad-4692f454bdab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:14.479482 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8fedcf64-b9c0-4c14-b1ad-4692f454bdab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:14.492731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedcf64-b9c0-4c14-b1ad-4692f454bdab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:14.494396 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedcf64-b9c0-4c14-b1ad-4692f454bdab service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:14.505219 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1232/2449] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:24:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:24:14.848435 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c757-8149-4e4e-8bb1-1de55ebf95fa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:14.849813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c757-8149-4e4e-8bb1-1de55ebf95fa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:14.850211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c757-8149-4e4e-8bb1-1de55ebf95fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:14.869819 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-acf6c757-8149-4e4e-8bb1-1de55ebf95fa None None] MFA Rules not processed for user `a46beb5fe7d145d5aa0a821c471f2dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:24:14.871049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-acf6c757-8149-4e4e-8bb1-1de55ebf95fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:14.878211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1218/2450] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:24:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:24:15.227421 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedcf64-b9c0-4c14-b1ad-4692f454bdab service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:15.237361 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedcf64-b9c0-4c14-b1ad-4692f454bdab service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:15.248339 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c181f-3582-479b-99b8-a711abc6cce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:15.249003 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c181f-3582-479b-99b8-a711abc6cce5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:15.249293 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c181f-3582-479b-99b8-a711abc6cce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:15.249624 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c181f-3582-479b-99b8-a711abc6cce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:15.251476 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-927c181f-3582-479b-99b8-a711abc6cce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:15.262363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c181f-3582-479b-99b8-a711abc6cce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:15.263789 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c181f-3582-479b-99b8-a711abc6cce5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:15.272601 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1233/2451] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:24:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:24:20.487026 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c56e9-67de-459a-ac52-bece57e42fd4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:20.487612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c56e9-67de-459a-ac52-bece57e42fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:20.487612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c56e9-67de-459a-ac52-bece57e42fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:20.507126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2e7c56e9-67de-459a-ac52-bece57e42fd4 None None] MFA Rules not processed for user `49c5d8480fbb4fe7b695924da4e9afa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:24:20.508360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2e7c56e9-67de-459a-ac52-bece57e42fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:20.521058 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1219/2452] 10.222.0.90 () {58 vars in 957 bytes} [Tue Jun 21 15:24:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 15:24:21.319208 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b9e7-77ad-485a-944c-0b2093751b08 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:21.319766 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b9e7-77ad-485a-944c-0b2093751b08 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:21.319880 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b9e7-77ad-485a-944c-0b2093751b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:21.351274 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-45b6b9e7-77ad-485a-944c-0b2093751b08 None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:24:21.352874 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45b6b9e7-77ad-485a-944c-0b2093751b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:21.361894 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1234/2453] 10.222.0.90 () {58 vars in 1009 bytes} [Tue Jun 21 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:24:21.384612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c56e9-67de-459a-ac52-bece57e42fd4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:21.394902 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c56e9-67de-459a-ac52-bece57e42fd4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:21.401248 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df3f4-6b95-42c5-81bb-c16ea90ada0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:21.402194 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df3f4-6b95-42c5-81bb-c16ea90ada0a service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:21.402480 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df3f4-6b95-42c5-81bb-c16ea90ada0a service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:21.402759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df3f4-6b95-42c5-81bb-c16ea90ada0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:21.417799 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312df3f4-6b95-42c5-81bb-c16ea90ada0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:21.419448 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312df3f4-6b95-42c5-81bb-c16ea90ada0a service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:21.429332 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1220/2454] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:24:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:24:31.344241 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=59 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:24:31.425126 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=53 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:24:38.940583 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b9e7-77ad-485a-944c-0b2093751b08 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:38.960617 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b9e7-77ad-485a-944c-0b2093751b08 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:38.966873 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c24893-6c08-4516-ae70-c2d6d761d7af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:38.967532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c24893-6c08-4516-ae70-c2d6d761d7af service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:38.967813 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c24893-6c08-4516-ae70-c2d6d761d7af service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:38.968191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c24893-6c08-4516-ae70-c2d6d761d7af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:38.970088 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-35c24893-6c08-4516-ae70-c2d6d761d7af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:39.067590 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c24893-6c08-4516-ae70-c2d6d761d7af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:39.069244 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c24893-6c08-4516-ae70-c2d6d761d7af service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:39.090987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1235/2455] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:24:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:24:46.963928 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ca75c-c6a1-4253-82c4-10e8df390f2d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:46.964459 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ca75c-c6a1-4253-82c4-10e8df390f2d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:46.964575 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ca75c-c6a1-4253-82c4-10e8df390f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:46.982151 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-547ca75c-c6a1-4253-82c4-10e8df390f2d None None] MFA Rules not processed for user `f0564976d31a4fe79742b978c6bee315`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 15:24:46.983334 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-547ca75c-c6a1-4253-82c4-10e8df390f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:46.996570 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1221/2456] 10.222.0.90 () {58 vars in 967 bytes} [Tue Jun 21 15:24:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 15:24:47.009649 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c24893-6c08-4516-ae70-c2d6d761d7af service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:47.022060 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c24893-6c08-4516-ae70-c2d6d761d7af service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:47.027527 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0da433-b69c-45f2-8e65-fc5d829eac1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ebffb0a0cf04bc0809a94ddd3a347b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:47.028166 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0da433-b69c-45f2-8e65-fc5d829eac1b service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:47.028450 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0da433-b69c-45f2-8e65-fc5d829eac1b service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:47.028723 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0da433-b69c-45f2-8e65-fc5d829eac1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:47.037961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0da433-b69c-45f2-8e65-fc5d829eac1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:47.039537 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0da433-b69c-45f2-8e65-fc5d829eac1b service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:47.048191 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1236/2457] 10.222.0.90 () {60 vars in 1384 bytes} [Tue Jun 21 15:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 15:24:53.926358 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ca75c-c6a1-4253-82c4-10e8df390f2d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:24:53.948431 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ca75c-c6a1-4253-82c4-10e8df390f2d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:24:53.954729 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0b852-f68f-40aa-a9c4-f5204f5a6323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:24:53.955540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0b852-f68f-40aa-a9c4-f5204f5a6323 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:24:53.956143 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0b852-f68f-40aa-a9c4-f5204f5a6323 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:24:53.956529 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0b852-f68f-40aa-a9c4-f5204f5a6323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:24:53.959905 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8fe0b852-f68f-40aa-a9c4-f5204f5a6323 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:24:53.983159 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0b852-f68f-40aa-a9c4-f5204f5a6323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:24:53.994540 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0b852-f68f-40aa-a9c4-f5204f5a6323 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:24:54.000492 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1222/2458] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:24:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:24:57.044773 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=47 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:25:00.385772 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0da433-b69c-45f2-8e65-fc5d829eac1b service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:25:00.395203 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0da433-b69c-45f2-8e65-fc5d829eac1b service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:25:00.399022 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e136-b820-472b-9bba-d6bf6ee48920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:25:00.399653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e136-b820-472b-9bba-d6bf6ee48920 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:25:00.399936 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e136-b820-472b-9bba-d6bf6ee48920 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:25:00.400210 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e136-b820-472b-9bba-d6bf6ee48920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:25:00.402252 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fce9e136-b820-472b-9bba-d6bf6ee48920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:25:00.470267 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9e136-b820-472b-9bba-d6bf6ee48920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:25:00.471816 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9e136-b820-472b-9bba-d6bf6ee48920 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:25:00.484360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1237/2459] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:25:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:25:03.995450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=9 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:25:10.479626 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=30 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:25:43.880759 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0b852-f68f-40aa-a9c4-f5204f5a6323 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:25:43.891894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0b852-f68f-40aa-a9c4-f5204f5a6323 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:25:43.897672 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:25:43.898493 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:25:43.898781 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:25:43.899057 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:25:43.907052 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:25:43.946618 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:25:43.948217 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:25:43.967222 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1223/2460] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:25:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:25:53.964404 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=19 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:26:12.821140 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e136-b820-472b-9bba-d6bf6ee48920 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:26:12.890819 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e136-b820-472b-9bba-d6bf6ee48920 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:26:12.897780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:26:12.898896 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:26:12.899478 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:26:12.900179 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:26:12.902422 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:26:12.950867 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:26:12.952484 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:26:12.969036 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1238/2461] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:26:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:26:22.959864 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=28 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:26:41.263897 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:26:41.265400 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:26:41.341748 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979aa7e-465c-4ed2-990c-7750137b00a4 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:26:41.346771 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:26:41.347481 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:26:41.347762 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:26:41.348034 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:26:41.349821 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:26:41.360969 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:26:41.363092 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:26:41.372792 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1224/2462] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:26:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:26:51.368718 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=33 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:27:33.435932 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:27:33.438576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:27:33.499573 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0035b61-24af-45fd-b1f8-ab89d6d8ac3f service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:27:33.505509 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8a8d-226c-461f-ac14-8a063144def0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:27:33.506009 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8a8d-226c-461f-ac14-8a063144def0 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:27:33.506297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8a8d-226c-461f-ac14-8a063144def0 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:27:33.506576 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8a8d-226c-461f-ac14-8a063144def0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:27:33.508470 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c4ef8a8d-226c-461f-ac14-8a063144def0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:27:33.522541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8a8d-226c-461f-ac14-8a063144def0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:27:33.524796 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8a8d-226c-461f-ac14-8a063144def0 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:27:33.537175 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1239/2463] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:27:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:27:43.533281 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=18 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:28:08.547360 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:28:08.548791 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:28:08.582436 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3525597-fee9-4f24-816c-e57ad8bf7786 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:28:08.586108 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8be472-e394-4d10-92fd-f5cb63fb3759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:28:08.586750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8be472-e394-4d10-92fd-f5cb63fb3759 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:28:08.587037 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8be472-e394-4d10-92fd-f5cb63fb3759 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:28:08.587317 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8be472-e394-4d10-92fd-f5cb63fb3759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:28:08.596287 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8be472-e394-4d10-92fd-f5cb63fb3759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:28:08.597774 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8be472-e394-4d10-92fd-f5cb63fb3759 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:28:08.607285 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1225/2464] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:28:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:28:18.602567 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=15 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:28:26.670532 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8a8d-226c-461f-ac14-8a063144def0 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:28:26.688781 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8a8d-226c-461f-ac14-8a063144def0 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:28:26.692375 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d59a6-6c91-46a1-ab07-623b33a23ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:28:26.693004 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d59a6-6c91-46a1-ab07-623b33a23ced service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:28:26.693289 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d59a6-6c91-46a1-ab07-623b33a23ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:28:26.693595 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d59a6-6c91-46a1-ab07-623b33a23ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:28:26.704502 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d59a6-6c91-46a1-ab07-623b33a23ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:28:26.705988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d59a6-6c91-46a1-ab07-623b33a23ced service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:28:26.717748 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1240/2465] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:28:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:28:27.818700 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8be472-e394-4d10-92fd-f5cb63fb3759 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:28:27.828299 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8be472-e394-4d10-92fd-f5cb63fb3759 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:28:27.831894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2ace7-0281-4458-be6d-a77feb100586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:28:27.832522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2ace7-0281-4458-be6d-a77feb100586 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:28:27.832811 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2ace7-0281-4458-be6d-a77feb100586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:28:27.833086 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2ace7-0281-4458-be6d-a77feb100586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:28:27.843650 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2ace7-0281-4458-be6d-a77feb100586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:28:27.845119 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2ace7-0281-4458-be6d-a77feb100586 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:28:27.855933 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1226/2466] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:28:36.712010 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:28:37.851077 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:28:58.577246 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d59a6-6c91-46a1-ab07-623b33a23ced service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:28:58.588745 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d59a6-6c91-46a1-ab07-623b33a23ced service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:28:58.594803 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b706-e8d0-4ef7-aeef-09a0a84df9e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:28:58.595433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b706-e8d0-4ef7-aeef-09a0a84df9e6 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:28:58.595720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b706-e8d0-4ef7-aeef-09a0a84df9e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:28:58.596002 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235b706-e8d0-4ef7-aeef-09a0a84df9e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:28:58.603974 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235b706-e8d0-4ef7-aeef-09a0a84df9e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:28:58.605588 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235b706-e8d0-4ef7-aeef-09a0a84df9e6 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:28:58.632638 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1241/2467] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:28:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:29:08.630026 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=13 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:29:36.348538 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2ace7-0281-4458-be6d-a77feb100586 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:29:36.357623 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2ace7-0281-4458-be6d-a77feb100586 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:29:36.366304 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bd8fe-77e6-462b-8c88-7a4e4bdf7593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:29:36.366957 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bd8fe-77e6-462b-8c88-7a4e4bdf7593 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:29:36.367236 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bd8fe-77e6-462b-8c88-7a4e4bdf7593 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:29:36.367509 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bd8fe-77e6-462b-8c88-7a4e4bdf7593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:29:36.376688 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bd8fe-77e6-462b-8c88-7a4e4bdf7593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:29:36.378133 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bd8fe-77e6-462b-8c88-7a4e4bdf7593 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:29:36.387112 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1227/2468] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:29:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:29:41.939096 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b706-e8d0-4ef7-aeef-09a0a84df9e6 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:29:41.948259 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235b706-e8d0-4ef7-aeef-09a0a84df9e6 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:29:41.951783 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dd6f5-c4f1-4995-bc32-d4a58150ed90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:29:41.952413 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dd6f5-c4f1-4995-bc32-d4a58150ed90 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:29:41.952693 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dd6f5-c4f1-4995-bc32-d4a58150ed90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:29:41.953040 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dd6f5-c4f1-4995-bc32-d4a58150ed90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:29:41.960440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dd6f5-c4f1-4995-bc32-d4a58150ed90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:29:41.961957 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dd6f5-c4f1-4995-bc32-d4a58150ed90 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:29:41.971148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1242/2469] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:29:46.382853 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:29:51.966473 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:30:08.698503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bd8fe-77e6-462b-8c88-7a4e4bdf7593 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:30:08.707033 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bd8fe-77e6-462b-8c88-7a4e4bdf7593 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:30:08.710612 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadf2ee-030e-46a4-be6c-749c4fdab046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:30:08.711239 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadf2ee-030e-46a4-be6c-749c4fdab046 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:30:08.711520 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadf2ee-030e-46a4-be6c-749c4fdab046 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:30:08.711796 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadf2ee-030e-46a4-be6c-749c4fdab046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:30:08.720372 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadf2ee-030e-46a4-be6c-749c4fdab046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:30:08.721818 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadf2ee-030e-46a4-be6c-749c4fdab046 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:30:08.732235 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1228/2470] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:30:18.726568 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:31:36.604679 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dd6f5-c4f1-4995-bc32-d4a58150ed90 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:31:36.614713 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dd6f5-c4f1-4995-bc32-d4a58150ed90 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:31:36.618484 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729de5-be5d-46ed-b830-85ae11d3d1b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:31:36.619114 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729de5-be5d-46ed-b830-85ae11d3d1b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:31:36.619518 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729de5-be5d-46ed-b830-85ae11d3d1b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:31:36.619672 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729de5-be5d-46ed-b830-85ae11d3d1b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:31:36.628987 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729de5-be5d-46ed-b830-85ae11d3d1b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:31:36.630440 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729de5-be5d-46ed-b830-85ae11d3d1b0 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:31:36.639653 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1243/2471] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:31:46.635363 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:31:48.278049 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadf2ee-030e-46a4-be6c-749c4fdab046 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:31:48.289406 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadf2ee-030e-46a4-be6c-749c4fdab046 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:31:48.294387 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543c8e3-eab0-4454-b907-d24894496006 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:31:48.295014 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543c8e3-eab0-4454-b907-d24894496006 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:31:48.295297 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543c8e3-eab0-4454-b907-d24894496006 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:31:48.295573 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543c8e3-eab0-4454-b907-d24894496006 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:31:48.304584 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543c8e3-eab0-4454-b907-d24894496006 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:31:48.306187 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543c8e3-eab0-4454-b907-d24894496006 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:31:48.316581 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1229/2472] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:31:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:31:58.311813 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:32:11.171248 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729de5-be5d-46ed-b830-85ae11d3d1b0 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:32:11.186082 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729de5-be5d-46ed-b830-85ae11d3d1b0 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:32:11.192433 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ced1c-37c9-46ba-88f8-f67314d68f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:32:11.193698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ced1c-37c9-46ba-88f8-f67314d68f55 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:32:11.193698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ced1c-37c9-46ba-88f8-f67314d68f55 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:32:11.193698 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ced1c-37c9-46ba-88f8-f67314d68f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:32:11.207037 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ced1c-37c9-46ba-88f8-f67314d68f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:32:11.208690 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ced1c-37c9-46ba-88f8-f67314d68f55 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:32:11.220455 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1244/2473] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:32:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:32:21.215728 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:33:36.942591 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543c8e3-eab0-4454-b907-d24894496006 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:33:36.944311 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c543c8e3-eab0-4454-b907-d24894496006 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:33:37.012894 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543c8e3-eab0-4454-b907-d24894496006 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:33:37.016496 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab97f8b-7aae-42bd-9578-f8cf99d64cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:33:37.017141 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab97f8b-7aae-42bd-9578-f8cf99d64cef service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:33:37.017427 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab97f8b-7aae-42bd-9578-f8cf99d64cef service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:33:37.017743 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab97f8b-7aae-42bd-9578-f8cf99d64cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:33:37.019968 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7ab97f8b-7aae-42bd-9578-f8cf99d64cef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:33:37.102523 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab97f8b-7aae-42bd-9578-f8cf99d64cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:33:37.104953 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab97f8b-7aae-42bd-9578-f8cf99d64cef service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:33:37.119166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1230/2474] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:33:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:33:37.126912 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ced1c-37c9-46ba-88f8-f67314d68f55 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:33:37.139050 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ced1c-37c9-46ba-88f8-f67314d68f55 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:33:37.142657 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30307f-9902-451f-b5cb-d98de94e73e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:33:37.143415 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30307f-9902-451f-b5cb-d98de94e73e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:33:37.143798 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30307f-9902-451f-b5cb-d98de94e73e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:33:37.144436 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30307f-9902-451f-b5cb-d98de94e73e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:33:37.146943 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d30307f-9902-451f-b5cb-d98de94e73e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:33:37.235270 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30307f-9902-451f-b5cb-d98de94e73e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:33:37.237453 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30307f-9902-451f-b5cb-d98de94e73e9 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:33:37.257237 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1245/2475] 10.222.0.90 () {60 vars in 1396 bytes} [Tue Jun 21 15:33:37 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:33:37.419694 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab97f8b-7aae-42bd-9578-f8cf99d64cef service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:33:37.434250 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab97f8b-7aae-42bd-9578-f8cf99d64cef service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:33:37.435166 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:33:37.435824 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:33:37.436107 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:33:37.436384 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:33:37.438368 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:33:37.453262 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:33:37.455735 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:33:37.469221 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1231/2476] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:33:47.253828 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=41 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:33:47.464074 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=60 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:34:09.144767 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30307f-9902-451f-b5cb-d98de94e73e9 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:34:09.158868 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30307f-9902-451f-b5cb-d98de94e73e9 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:34:09.164444 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:34:09.165094 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:34:09.165384 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:34:09.165720 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:34:09.177388 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:34:09.248749 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:34:09.250360 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:34:09.259200 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1246/2477] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:34:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:34:19.255165 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=33 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:34:44.915846 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:34:44.917651 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:34:44.987643 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30bd37-6607-4bac-835a-9b72f3e19295 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:34:44.991197 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7e326-99b1-4dc3-a988-90164a625ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:34:44.991834 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e326-99b1-4dc3-a988-90164a625ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:34:44.992117 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e326-99b1-4dc3-a988-90164a625ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:34:44.992394 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e326-99b1-4dc3-a988-90164a625ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:34:44.994310 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d1e7e326-99b1-4dc3-a988-90164a625ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:34:45.004510 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7e326-99b1-4dc3-a988-90164a625ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:34:45.005966 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7e326-99b1-4dc3-a988-90164a625ea9 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:34:45.014503 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1232/2478] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:34:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:34:55.010450 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=31 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:35:37.726172 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:35:37.727587 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:35:37.741731 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6a0a-d5a4-43d7-8e0c-63ad56c2599b service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:35:37.747591 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd3ffc0a30648139b2cbf19bb6bd535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:35:37.748352 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:35:37.748637 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:35:37.748920 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:35:37.750967 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:35:37.759032 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7e326-99b1-4dc3-a988-90164a625ea9 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:35:37.769669 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7e326-99b1-4dc3-a988-90164a625ea9 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:35:37.773432 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17591fc3-27d5-49a5-a8ae-5d1d7250e754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:35:37.774165 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591fc3-27d5-49a5-a8ae-5d1d7250e754 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:35:37.774522 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591fc3-27d5-49a5-a8ae-5d1d7250e754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:35:37.774873 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591fc3-27d5-49a5-a8ae-5d1d7250e754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:35:37.776800 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-17591fc3-27d5-49a5-a8ae-5d1d7250e754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:35:37.835199 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:35:37.836817 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:35:37.856780 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1247/2479] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:35:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:35:37.864702 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17591fc3-27d5-49a5-a8ae-5d1d7250e754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:35:37.866204 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17591fc3-27d5-49a5-a8ae-5d1d7250e754 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:35:37.894536 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1233/2480] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:35:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 15:35:47.854049 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=41 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:35:47.885619 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=41 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:36:50.188266 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:36:50.190135 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:36:50.330715 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27424076-1d00-429f-9754-6606d2aa061a service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:36:50.335988 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83511292-8c70-4984-8dd3-6f1431a5fdcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:36:50.337157 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83511292-8c70-4984-8dd3-6f1431a5fdcb service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:36:50.337515 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83511292-8c70-4984-8dd3-6f1431a5fdcb service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:36:50.337797 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83511292-8c70-4984-8dd3-6f1431a5fdcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:36:50.339734 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-83511292-8c70-4984-8dd3-6f1431a5fdcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:36:50.351367 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83511292-8c70-4984-8dd3-6f1431a5fdcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:36:50.353640 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83511292-8c70-4984-8dd3-6f1431a5fdcb service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:36:50.363401 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1248/2481] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:36:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:37:00.359148 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=63 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:37:38.291351 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17591fc3-27d5-49a5-a8ae-5d1d7250e754 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:37:38.311003 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17591fc3-27d5-49a5-a8ae-5d1d7250e754 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:37:38.314461 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:37:38.315100 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:37:38.315379 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:37:38.315652 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:37:38.317976 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:37:38.399777 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:37:38.401211 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:37:38.420270 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1234/2482] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:37:48.417551 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=46 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:39:51.940300 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83511292-8c70-4984-8dd3-6f1431a5fdcb service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:39:51.959869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83511292-8c70-4984-8dd3-6f1431a5fdcb service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:39:51.963541 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32ccb2-5e35-4e48-8a82-b06d518a96bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b3093a7415419cbb6d50701b09b7e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:39:51.964174 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32ccb2-5e35-4e48-8a82-b06d518a96bc service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:39:51.964461 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32ccb2-5e35-4e48-8a82-b06d518a96bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:39:51.964742 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32ccb2-5e35-4e48-8a82-b06d518a96bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:39:51.972086 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32ccb2-5e35-4e48-8a82-b06d518a96bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:39:51.973611 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32ccb2-5e35-4e48-8a82-b06d518a96bc service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:39:51.981538 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1249/2483] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:39:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:40:01.978040 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:40:10.013878 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:40:10.015750 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 15:40:10.049281 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de2ee3-2ca3-4a68-8a9a-e34726c16380 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:40:10.052838 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964e0a1-2df3-413d-8a4a-8358a9976427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b480c19eb6ec42979a81ad274acb1f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:40:10.053489 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964e0a1-2df3-413d-8a4a-8358a9976427 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:40:10.053780 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964e0a1-2df3-413d-8a4a-8358a9976427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:40:10.054054 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964e0a1-2df3-413d-8a4a-8358a9976427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:40:10.062180 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964e0a1-2df3-413d-8a4a-8358a9976427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:40:10.063854 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964e0a1-2df3-413d-8a4a-8358a9976427 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:40:10.072547 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1235/2484] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:40:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:40:20.068617 dv-cinder-799871-20-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=15 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 15:41:57.366869 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32ccb2-5e35-4e48-8a82-b06d518a96bc service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 15:41:57.378972 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32ccb2-5e35-4e48-8a82-b06d518a96bc service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 15:41:57.384023 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c52262-36c6-431d-9539-144ae7774912 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e916fba8123451587f5e13568630015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4014ec50b88f4aef8757535c09207981', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 15:41:57.384655 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c52262-36c6-431d-9539-144ae7774912 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 15:41:57.384941 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c52262-36c6-431d-9539-144ae7774912 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 15:41:57.385223 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c52262-36c6-431d-9539-144ae7774912 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 15:41:57.394297 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c52262-36c6-431d-9539-144ae7774912 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 15:41:57.395961 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c52262-36c6-431d-9539-144ae7774912 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 15:41:57.406842 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1250/2485] 10.222.0.90 () {60 vars in 1365 bytes} [Tue Jun 21 15:41:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 15:42:07.401786 dv-cinder-799871-20-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}